[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:34 dist-test-slave-lgr5 krb5kdc[26469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:34 dist-test-slave-lgr5 krb5kdc[26469](info): set up 2 sockets
Aug 07 04:59:34 dist-test-slave-lgr5 krb5kdc[26469](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 04:59:35.392457 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:35 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:35.521785 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45245
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:40801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:45245
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:35.648788 26487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:35.649065 26487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:35.649109 26487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:35.653116 26487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:35.653184 26487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:35.653204 26487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:35.653235 26487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:35.653261 26487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:35.658849 26487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:40801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:45245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:35.660403 26487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:35.661675 26487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:35.674129 26493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:35.674911 26487 server_base.cc:1034] running on GCE node
W20260807 04:59:35.674921 26499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:35.675238 26494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:35.676234 26487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:35.678057 26487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:35.679227 26487 hybrid_clock.cc:648] HybridClock initialized: now 1786078775679190 us; error 75 us; skew 500 ppm
Aug 07 04:59:35 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078775, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:35.682175 26487 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:35.683444 26487 webserver.cc:460] Webserver started at http://127.25.214.254:44585/ using document root <none> and password file <none>
I20260807 04:59:35.684435 26487 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:35.684517 26487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:35.684937 26487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:35.687836 26487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "beaa1b5308094b729380fb178ea49a8d"
format_stamp: "Formatted at 2026-08-07 04:59:35 on dist-test-slave-lgr5"
server_key: "96995ecfc64dcee225302e5983c8358b"
server_key_iv: "8113fd6601f9db06ada639ecf8bc4528"
server_key_version: "encryptionkey@0"
I20260807 04:59:35.688547 26487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "beaa1b5308094b729380fb178ea49a8d"
format_stamp: "Formatted at 2026-08-07 04:59:35 on dist-test-slave-lgr5"
server_key: "96995ecfc64dcee225302e5983c8358b"
server_key_iv: "8113fd6601f9db06ada639ecf8bc4528"
server_key_version: "encryptionkey@0"
I20260807 04:59:35.694165 26487 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:59:35.698019 26512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:35.699734 26487 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:35.699949 26487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "beaa1b5308094b729380fb178ea49a8d"
format_stamp: "Formatted at 2026-08-07 04:59:35 on dist-test-slave-lgr5"
server_key: "96995ecfc64dcee225302e5983c8358b"
server_key_iv: "8113fd6601f9db06ada639ecf8bc4528"
server_key_version: "encryptionkey@0"
I20260807 04:59:35.700102 26487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:35.727847 26487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:35.731141 26487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:35.731329 26487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:35.740623 26487 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:45245
I20260807 04:59:35.740681 26590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:45245 every 8 connection(s)
I20260807 04:59:35.742039 26487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:35.747434 26591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:35.750635 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26487
I20260807 04:59:35.750819 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:35.752725 26459 external_mini_cluster.cc:1428] Setting key bcb374e5ec67e4c80f1a0473a9e21fa1
I20260807 04:59:35.758955 26591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d: Bootstrap starting.
I20260807 04:59:35.764045 26591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:35.765384 26591 log.cc:824] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:35.768749 26591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d: No bootstrap required, opened a new log
I20260807 04:59:35.774626 26591 raft_consensus.cc:348] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaa1b5308094b729380fb178ea49a8d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45245 } }
I20260807 04:59:35.775089 26591 raft_consensus.cc:374] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:35.775213 26591 raft_consensus.cc:729] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: beaa1b5308094b729380fb178ea49a8d, State: Initialized, Role: FOLLOWER
I20260807 04:59:35.776271 26591 consensus_queue.cc:260] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaa1b5308094b729380fb178ea49a8d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45245 } }
Aug 07 04:59:35 dist-test-slave-lgr5 krb5kdc[26469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:35.776484 26591 raft_consensus.cc:388] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:35.776615 26591 raft_consensus.cc:482] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:35.776762 26591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:35.777734 26591 raft_consensus.cc:504] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaa1b5308094b729380fb178ea49a8d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45245 } }
I20260807 04:59:35.778345 26591 leader_election.cc:302] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: beaa1b5308094b729380fb178ea49a8d; no voters:
I20260807 04:59:35.778752 26591 leader_election.cc:288] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:35.778920 26598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:35.779170 26598 raft_consensus.cc:686] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [term 1 LEADER]: Becoming Leader. State: Replica: beaa1b5308094b729380fb178ea49a8d, State: Running, Role: LEADER
I20260807 04:59:35.779650 26598 consensus_queue.cc:237] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaa1b5308094b729380fb178ea49a8d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45245 } }
I20260807 04:59:35.780611 26591 sys_catalog.cc:564] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:35.782428 26601 sys_catalog.cc:455] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader beaa1b5308094b729380fb178ea49a8d. Latest consensus state: current_term: 1 leader_uuid: "beaa1b5308094b729380fb178ea49a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaa1b5308094b729380fb178ea49a8d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45245 } } }
I20260807 04:59:35.782593 26601 sys_catalog.cc:458] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:35.784852 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:35.760351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.25.214.254:45245)
0807 04:59:35.760766 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:35.760782 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:35.760857 (+ 75us) server_negotiation.cc:407] Connection header received
0807 04:59:35.765140 (+ 4283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:35.765156 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:35.765569 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:35.765845 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:35.768988 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:35.770012 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:35.771677 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:35.772191 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:35.772319 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:35.777497 (+ 5178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:35.777542 (+ 45us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:35.777556 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:35.777593 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:35.779744 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:35.780543 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:35.780550 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:35.780555 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:35.780701 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:35.781121 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:35.781124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:35.781126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:35.781790 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:35.781995 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:35.783595 (+ 1600us) server_negotiation.cc:299] Negotiation successful
0807 04:59:35.783890 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":120,"threads_started":1}
I20260807 04:59:35.782985 26599 sys_catalog.cc:455] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "beaa1b5308094b729380fb178ea49a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaa1b5308094b729380fb178ea49a8d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45245 } } }
I20260807 04:59:35.786149 26599 sys_catalog.cc:458] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d [sys.catalog]: This master's current role is: LEADER
W20260807 04:59:35.788242 26618 catalog_manager.cc:1558] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:59:35.788380 26618 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:59:35.788455 26617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:35.789363 26617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:35.796736 26617 catalog_manager.cc:1347] Generated new cluster ID: 2369aaff8504436e9395b0a29625b84a
I20260807 04:59:35.796805 26617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:35.819183 26617 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:35.820200 26617 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:35.834556 26617 catalog_manager.cc:5868] T 00000000000000000000000000000000 P beaa1b5308094b729380fb178ea49a8d: Generated new TSK 0
I20260807 04:59:35.835629 26617 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:35.873553 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45245
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:40801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:35.991299 26625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:35.991544 26625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:35.991588 26625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:35.997010 26625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:35.997107 26625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:35.997195 26625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:36.004251 26625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:40801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45245
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:36.005400 26625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:36.006376 26625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:36.016328 26633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:36.016496 26625 server_base.cc:1034] running on GCE node
W20260807 04:59:36.016355 26631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:36.016338 26638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:36.016956 26625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:36.017565 26625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:36.018735 26625 hybrid_clock.cc:648] HybridClock initialized: now 1786078776018710 us; error 40 us; skew 500 ppm
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:36.021382 26625 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:36.022186 26625 webserver.cc:460] Webserver started at http://127.25.214.193:40475/ using document root <none> and password file <none>
I20260807 04:59:36.022716 26625 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:36.022781 26625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:36.022984 26625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:36.024998 26625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "1028d4b60adb4f9ab3a63bfce89eaa8e"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "74f27637269f9a635863e9316f0b6c41"
server_key_iv: "b7c429b48e71517be818934d75129a8a"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.025523 26625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "1028d4b60adb4f9ab3a63bfce89eaa8e"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "74f27637269f9a635863e9316f0b6c41"
server_key_iv: "b7c429b48e71517be818934d75129a8a"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.028986 26625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:59:36.031208 26649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.032470 26625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 04:59:36.032586 26625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "1028d4b60adb4f9ab3a63bfce89eaa8e"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "74f27637269f9a635863e9316f0b6c41"
server_key_iv: "b7c429b48e71517be818934d75129a8a"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.032680 26625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:36.043385 26625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:36.046190 26625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:36.046350 26625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:36.046984 26625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:36.048061 26625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:36.048142 26625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.048204 26625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:36.048228 26625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.057636 26625 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:43243
I20260807 04:59:36.057683 26823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:43243 every 8 connection(s)
I20260807 04:59:36.058539 26625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:36.061769 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26625
I20260807 04:59:36.061892 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:36.062196 26459 external_mini_cluster.cc:1428] Setting key 5ed85c1d0cb5b0497249c31b4521466b
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 04:59:36.074236 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.060921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:44391 (local address 127.25.214.254:45245)
0807 04:59:36.061069 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:36.061073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:36.062256 (+ 1183us) server_negotiation.cc:407] Connection header received
0807 04:59:36.063315 (+ 1059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:36.063317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:36.063360 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:36.063422 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:36.064860 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.065392 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.067063 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.067304 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.067388 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.070445 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:36.070448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:36.070451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:36.070479 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:36.071915 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.072588 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.072590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.072591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.072670 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.073053 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.073055 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.073056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.073266 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:36.073345 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:36.073903 (+ 558us) server_negotiation.cc:299] Negotiation successful
0807 04:59:36.074026 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:59:36.075006 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.061294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45245 (local address 127.25.214.193:44391)
0807 04:59:36.062080 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:36.062131 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:36.063092 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:36.063645 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:36.063655 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:36.064155 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:36.064685 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:36.064701 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.065529 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.065532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:36.066919 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:36.066934 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.067446 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.067449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:36.067616 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.068362 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:36.068380 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:36.070222 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:36.072051 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:36.072059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:36.072101 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:36.072469 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:36.072756 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:36.072759 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:36.072761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:36.072961 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:36.073371 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:36.073377 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:36.073674 (+ 297us) client_negotiation.cc:769] Sending connection context
0807 04:59:36.073843 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 04:59:36.074142 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":147,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 04:59:36.076524 26824 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45245
I20260807 04:59:36.076788 26824 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:36.077324 26824 heartbeater.cc:511] Master 127.25.214.254:45245 requested a full tablet report, sending...
I20260807 04:59:36.079756 26535 ts_manager.cc:194] Registered new tserver with Master: 1028d4b60adb4f9ab3a63bfce89eaa8e (127.25.214.193:43243)
I20260807 04:59:36.081902 26535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:44391
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:36.095244 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45245
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:40801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:36.207592 26831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:36.207868 26831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:36.207912 26831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:36.211885 26831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:36.211943 26831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:36.212001 26831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:36.217322 26831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:40801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45245
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:36.218364 26831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:36.219329 26831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:36.228693 26844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:36.228693 26842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:36.228744 26831 server_base.cc:1034] running on GCE node
W20260807 04:59:36.228689 26841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:36.229368 26831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:36.230041 26831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:36.231206 26831 hybrid_clock.cc:648] HybridClock initialized: now 1786078776231187 us; error 36 us; skew 500 ppm
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:36.234203 26831 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:36.235255 26831 webserver.cc:460] Webserver started at http://127.25.214.194:45143/ using document root <none> and password file <none>
I20260807 04:59:36.235842 26831 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:36.235908 26831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:36.236138 26831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:36.238267 26831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "3e6e31f5053d4340acaf976d59c8b96c"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "10206199f7a3020d75d8d58f1321eb2d"
server_key_iv: "a116ffdb675585d5c203ec469ce7b3ef"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.238793 26831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "3e6e31f5053d4340acaf976d59c8b96c"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "10206199f7a3020d75d8d58f1321eb2d"
server_key_iv: "a116ffdb675585d5c203ec469ce7b3ef"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.242419 26831 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 04:59:36.244750 26857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.245899 26831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:36.245996 26831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "3e6e31f5053d4340acaf976d59c8b96c"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "10206199f7a3020d75d8d58f1321eb2d"
server_key_iv: "a116ffdb675585d5c203ec469ce7b3ef"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.246091 26831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:36.264778 26831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:36.267727 26831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:36.267879 26831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:36.268471 26831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:36.269237 26831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:36.269281 26831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.269320 26831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:36.269340 26831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.277940 26831 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:38507
I20260807 04:59:36.277969 27035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:38507 every 8 connection(s)
I20260807 04:59:36.278844 26831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:36.281980 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26831
I20260807 04:59:36.282097 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:36.282398 26459 external_mini_cluster.cc:1428] Setting key 3a0a4bb3dd8928275ff2ffa5390bc107
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 04:59:36.293514 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.280700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:33941 (local address 127.25.214.254:45245)
0807 04:59:36.280824 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:36.280828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:36.281970 (+ 1142us) server_negotiation.cc:407] Connection header received
0807 04:59:36.283171 (+ 1201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:36.283174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:36.283224 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:36.283320 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:36.284705 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.285430 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.286874 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.287195 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.287297 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.289989 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:36.289993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:36.289995 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:36.290020 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:36.291341 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.291854 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.291857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.291858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.291938 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.292335 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.292338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.292340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.292547 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:36.292639 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:36.293203 (+ 564us) server_negotiation.cc:299] Negotiation successful
0807 04:59:36.293340 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 04:59:36.294365 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.281060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45245 (local address 127.25.214.194:33941)
0807 04:59:36.281803 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:36.281859 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:36.282769 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:36.283501 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:36.283508 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:36.283987 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:36.284578 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:36.284593 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.285565 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.285568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:36.286752 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:36.286763 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.287362 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.287367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:36.287563 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.288159 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:36.288179 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:36.289816 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:36.291463 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:36.291470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:36.291488 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:36.291757 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:36.292026 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:36.292041 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:36.292044 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:36.292245 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:36.292652 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:36.292660 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:36.292946 (+ 286us) client_negotiation.cc:769] Sending connection context
0807 04:59:36.293128 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 04:59:36.293490 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 04:59:36.295540 27036 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45245
I20260807 04:59:36.295789 27036 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:36.296339 27036 heartbeater.cc:511] Master 127.25.214.254:45245 requested a full tablet report, sending...
I20260807 04:59:36.297358 26535 ts_manager.cc:194] Registered new tserver with Master: 3e6e31f5053d4340acaf976d59c8b96c (127.25.214.194:38507)
I20260807 04:59:36.297925 26535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:33941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:36.311153 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45245
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:40801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:36.424757 27043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:36.425027 27043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:36.425086 27043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:36.428988 27043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:36.429050 27043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:36.429128 27043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:36.434266 27043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:40801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45245
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:36.435386 27043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:36.436504 27043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:36.446585 27051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:36.446585 27056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:36.446708 27043 server_base.cc:1034] running on GCE node
W20260807 04:59:36.446585 27052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:36.447275 27043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:36.447938 27043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:36.449101 27043 hybrid_clock.cc:648] HybridClock initialized: now 1786078776449080 us; error 38 us; skew 500 ppm
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:36.451781 27043 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:36.452698 27043 webserver.cc:460] Webserver started at http://127.25.214.195:45161/ using document root <none> and password file <none>
I20260807 04:59:36.453251 27043 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:36.453315 27043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:36.453528 27043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:36.455545 27043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "5bcda4f26a194ed58f1025f2f4dc3be0"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "d05ee4a91b1638cc04a09a40918d5aa6"
server_key_iv: "0869e5b207e08c7afe5a840eabd93d49"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.456106 27043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "5bcda4f26a194ed58f1025f2f4dc3be0"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "d05ee4a91b1638cc04a09a40918d5aa6"
server_key_iv: "0869e5b207e08c7afe5a840eabd93d49"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.459550 27043 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:36.461815 27068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.462965 27043 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:36.463071 27043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "5bcda4f26a194ed58f1025f2f4dc3be0"
format_stamp: "Formatted at 2026-08-07 04:59:36 on dist-test-slave-lgr5"
server_key: "d05ee4a91b1638cc04a09a40918d5aa6"
server_key_iv: "0869e5b207e08c7afe5a840eabd93d49"
server_key_version: "encryptionkey@0"
I20260807 04:59:36.463161 27043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:36.473869 27043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:36.476902 27043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:36.477079 27043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:36.477643 27043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:36.478436 27043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:36.478497 27043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.478550 27043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:36.478575 27043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:36.487617 27043 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:38377
I20260807 04:59:36.487690 27247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:38377 every 8 connection(s)
I20260807 04:59:36.488566 27043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:36.497937 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27043
I20260807 04:59:36.498054 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:36.498348 26459 external_mini_cluster.cc:1428] Setting key fa74ce83313c12e62e8ab06abba7708c
I20260807 04:59:36.501854 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.490324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:34409 (local address 127.25.214.254:45245)
0807 04:59:36.490457 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:36.490461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:36.491493 (+ 1032us) server_negotiation.cc:407] Connection header received
0807 04:59:36.492425 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:36.492428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:36.492481 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:36.492547 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:36.493783 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.494325 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.495487 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.495691 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.495761 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.498240 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:36.498244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:36.498247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:36.498277 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:36.499734 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.500322 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.500327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.500329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.500428 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.500746 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.500750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.500751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.500986 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:36.501094 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:36.501636 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 04:59:36.501734 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 04:59:36.502691 27251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.490720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45245 (local address 127.25.214.195:34409)
0807 04:59:36.491344 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:36.491387 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:36.492220 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:36.492729 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:36.492736 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:36.493115 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:36.493631 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:36.493645 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.494437 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.494441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:36.495389 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:36.495400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.495812 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.495815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:36.495967 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.496571 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:36.496588 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:36.498062 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:36.499849 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:36.499854 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:36.499868 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:36.500226 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:36.500515 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:36.500517 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:36.500518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:36.500647 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:36.501094 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:36.501099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:36.501367 (+ 268us) client_negotiation.cc:769] Sending connection context
0807 04:59:36.501561 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 04:59:36.501824 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":100,"threads_started":1}
I20260807 04:59:36.503816 27249 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45245
I20260807 04:59:36.504027 27249 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:36.504568 27249 heartbeater.cc:511] Master 127.25.214.254:45245 requested a full tablet report, sending...
I20260807 04:59:36.505543 26535 ts_manager.cc:194] Registered new tserver with Master: 5bcda4f26a194ed58f1025f2f4dc3be0 (127.25.214.195:38377)
I20260807 04:59:36.506103 26535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:34409
I20260807 04:59:36.513280 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:36.539740 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.531013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40654 (local address 127.25.214.193:43243)
0807 04:59:36.531271 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:36.531285 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:36.531326 (+ 41us) server_negotiation.cc:407] Connection header received
0807 04:59:36.531462 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:36.531468 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:36.531677 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:36.531801 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:36.532473 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.533251 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.533997 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.534351 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.534426 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.536735 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:36.536745 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:36.536757 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:36.536780 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:36.538254 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.538609 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.538613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.538615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.538691 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.538870 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.538872 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.538873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.539097 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:36.539253 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:36.539381 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 04:59:36.539526 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":63,"threads_started":1}
W20260807 04:59:36.540861 26695 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40654
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[26469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:36.565847 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:36.558018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40668 (local address 127.25.214.193:43243)
0807 04:59:36.558184 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:36.558188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:36.558255 (+ 67us) server_negotiation.cc:407] Connection header received
0807 04:59:36.558380 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:36.558382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:36.558424 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:36.558483 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:36.559068 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.559576 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.560391 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:36.560680 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:36.560781 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:36.563058 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:36.563061 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:36.563064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:36.563088 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:36.564354 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.564733 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.564737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.564739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.564816 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:36.565059 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:36.565063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:36.565065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:36.565225 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:36.565334 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:36.565572 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 04:59:36.565687 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:59:36.566995 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26625
I20260807 04:59:36.581382 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26831
I20260807 04:59:36.595170 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27043
I20260807 04:59:36.604754 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26487
2026-08-07T04:59:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2501 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[27269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[27269](info): set up 2 sockets
Aug 07 04:59:36 dist-test-slave-lgr5 krb5kdc[27269](info): commencing operation
krb5kdc: starting...
W20260807 04:59:37.771663 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:37 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:37.894780 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:35585
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:36361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:35585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:38.011463 27288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:38.011780 27288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:38.011839 27288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:38.015931 27288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:38.016014 27288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:38.016042 27288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:38.016063 27288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:38.016101 27288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:38.021560 27288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:35585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:35585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:38.022719 27288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:38.023759 27288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:38.032027 27295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.032052 27288 server_base.cc:1034] running on GCE node
W20260807 04:59:38.032105 27294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:38.032105 27297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.032840 27288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:38.033901 27288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:38.035056 27288 hybrid_clock.cc:648] HybridClock initialized: now 1786078778035034 us; error 36 us; skew 500 ppm
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:38.037784 27288 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:38.038698 27288 webserver.cc:460] Webserver started at http://127.25.214.254:36267/ using document root <none> and password file <none>
I20260807 04:59:38.039244 27288 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:38.039306 27288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:38.039525 27288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:38.041635 27288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "38c049d831964bedb6962d1c5f6fe1c8"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "450e40de012a112b3b8568811ef6c7d7"
server_key_iv: "b59307a144fc373de0af01978be84940"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.042186 27288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "38c049d831964bedb6962d1c5f6fe1c8"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "450e40de012a112b3b8568811ef6c7d7"
server_key_iv: "b59307a144fc373de0af01978be84940"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.045926 27288 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 04:59:38.048303 27309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.049551 27288 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:38.049664 27288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "38c049d831964bedb6962d1c5f6fe1c8"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "450e40de012a112b3b8568811ef6c7d7"
server_key_iv: "b59307a144fc373de0af01978be84940"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.049767 27288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:38.069244 27288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:38.072008 27288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:38.072201 27288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:38.078735 27288 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:35585
I20260807 04:59:38.078812 27388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:35585 every 8 connection(s)
I20260807 04:59:38.079653 27288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:38.081756 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27288
I20260807 04:59:38.081871 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:38.082157 26459 external_mini_cluster.cc:1428] Setting key 6f246af42b003b0111af42ab34dcedfd
I20260807 04:59:38.082590 27390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:38.088479 27390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8: Bootstrap starting.
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:38.090847 27390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:38.091567 27390 log.cc:824] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:38.093547 27390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8: No bootstrap required, opened a new log
I20260807 04:59:38.095336 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.083533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.25.214.254:35585)
0807 04:59:38.083964 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.083979 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.084014 (+ 35us) server_negotiation.cc:407] Connection header received
0807 04:59:38.084687 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.084702 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.085002 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.085289 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:38.086062 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.087041 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.087849 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.088350 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.088510 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.090987 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:38.090994 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:38.091008 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:38.091036 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:38.092650 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.093059 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.093064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.093068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.093183 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.093437 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.093441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.093443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.093870 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:38.094042 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.094339 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.094623 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":147,"threads_started":1}
I20260807 04:59:38.097832 27390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c049d831964bedb6962d1c5f6fe1c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35585 } }
I20260807 04:59:38.098124 27390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:38.098197 27390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c049d831964bedb6962d1c5f6fe1c8, State: Initialized, Role: FOLLOWER
I20260807 04:59:38.098608 27390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c049d831964bedb6962d1c5f6fe1c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35585 } }
I20260807 04:59:38.098733 27390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:38.098800 27390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:38.098901 27390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:38.099839 27390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c049d831964bedb6962d1c5f6fe1c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35585 } }
I20260807 04:59:38.100212 27390 leader_election.cc:302] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38c049d831964bedb6962d1c5f6fe1c8; no voters:
I20260807 04:59:38.100543 27390 leader_election.cc:288] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:38.100630 27397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:38.100837 27397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [term 1 LEADER]: Becoming Leader. State: Replica: 38c049d831964bedb6962d1c5f6fe1c8, State: Running, Role: LEADER
I20260807 04:59:38.101204 27397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c049d831964bedb6962d1c5f6fe1c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35585 } }
I20260807 04:59:38.101780 27390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:38.102843 27400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c049d831964bedb6962d1c5f6fe1c8. Latest consensus state: current_term: 1 leader_uuid: "38c049d831964bedb6962d1c5f6fe1c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c049d831964bedb6962d1c5f6fe1c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35585 } } }
I20260807 04:59:38.102985 27400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:38.103274 27399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38c049d831964bedb6962d1c5f6fe1c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c049d831964bedb6962d1c5f6fe1c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35585 } } }
I20260807 04:59:38.103392 27399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:38.104054 27412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:38.106968 27412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:38.112349 27412 catalog_manager.cc:1347] Generated new cluster ID: cd22840ad5484707999f812677f22e99
I20260807 04:59:38.112427 27412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:38.136507 27412 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:38.137467 27412 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:38.148804 27412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38c049d831964bedb6962d1c5f6fe1c8: Generated new TSK 0
I20260807 04:59:38.149672 27412 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:38.186856 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35585
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:36361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:38.295476 27427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:38.295732 27427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:38.295773 27427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:38.299672 27427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:38.299731 27427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:38.299788 27427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:38.305146 27427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35585
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:38.306281 27427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:38.307314 27427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:38.316753 27442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:38.316748 27440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.316865 27427 server_base.cc:1034] running on GCE node
W20260807 04:59:38.316751 27444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.317389 27427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:38.317973 27427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:38.319124 27427 hybrid_clock.cc:648] HybridClock initialized: now 1786078778319103 us; error 34 us; skew 500 ppm
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:38.321667 27427 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:38.322489 27427 webserver.cc:460] Webserver started at http://127.25.214.193:35789/ using document root <none> and password file <none>
I20260807 04:59:38.323009 27427 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:38.323081 27427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:38.323287 27427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:38.325273 27427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "f226a6f0ef7b4046ac40df2b91228508"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "0ad4d9910761ba7d7127b308b42f7fb6"
server_key_iv: "683d7045befcc6b87a7b503e04a72f89"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.325790 27427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "f226a6f0ef7b4046ac40df2b91228508"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "0ad4d9910761ba7d7127b308b42f7fb6"
server_key_iv: "683d7045befcc6b87a7b503e04a72f89"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.329257 27427 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:59:38.331445 27455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.332582 27427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:38.332686 27427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "f226a6f0ef7b4046ac40df2b91228508"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "0ad4d9910761ba7d7127b308b42f7fb6"
server_key_iv: "683d7045befcc6b87a7b503e04a72f89"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.332775 27427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:38.357635 27427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:38.360143 27427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:38.360299 27427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:38.360827 27427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:38.361588 27427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:38.361634 27427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.361683 27427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:38.361711 27427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.369863 27427 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:45591
I20260807 04:59:38.369889 27636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:45591 every 8 connection(s)
I20260807 04:59:38.370675 27427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:38.372730 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27427
I20260807 04:59:38.372815 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:38.373049 26459 external_mini_cluster.cc:1428] Setting key 20fef3bb2d4b90575b0d99229e05559c
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 04:59:38.383162 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.372313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:51333 (local address 127.25.214.254:35585)
0807 04:59:38.372446 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.372451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.373360 (+ 909us) server_negotiation.cc:407] Connection header received
0807 04:59:38.374411 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.374415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.374467 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.374543 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:38.375603 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.376169 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.377253 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.377485 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.377581 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.380000 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:38.380003 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:38.380005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:38.380035 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:38.381302 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.381760 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.381763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.381764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.381836 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.382136 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.382139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.382141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.382320 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:38.382407 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.382862 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.382984 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 04:59:38.383849 27644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.372700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35585 (local address 127.25.214.193:51333)
0807 04:59:38.373190 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:38.373246 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:38.374229 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:38.374688 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:38.374695 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:38.375014 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:38.375467 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.375479 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.376288 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.376291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.377138 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.377148 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.377616 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.377621 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.377772 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.378333 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:38.378347 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:38.379851 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:38.381405 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:38.381410 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:38.381423 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:38.381668 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:38.381916 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:38.381920 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:38.381922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:38.382050 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:38.382418 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:38.382425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:38.382652 (+ 227us) client_negotiation.cc:769] Sending connection context
0807 04:59:38.382806 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 04:59:38.383097 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 04:59:38.385016 27639 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35585
I20260807 04:59:38.385239 27639 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:38.385685 27639 heartbeater.cc:511] Master 127.25.214.254:35585 requested a full tablet report, sending...
I20260807 04:59:38.387064 27336 ts_manager.cc:194] Registered new tserver with Master: f226a6f0ef7b4046ac40df2b91228508 (127.25.214.193:45591)
I20260807 04:59:38.388195 27336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:51333
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:38.399186 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35585
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:36361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:38.510772 27647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:38.511055 27647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:38.511114 27647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:38.515327 27647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:38.515396 27647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:38.515473 27647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:38.520936 27647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35585
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:38.522107 27647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:38.523203 27647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:38.532480 27656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.532495 27647 server_base.cc:1034] running on GCE node
W20260807 04:59:38.532548 27662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:38.532480 27655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.533118 27647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:38.533732 27647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:38.534886 27647 hybrid_clock.cc:648] HybridClock initialized: now 1786078778534855 us; error 48 us; skew 500 ppm
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:38.537695 27647 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:38.538527 27647 webserver.cc:460] Webserver started at http://127.25.214.194:45445/ using document root <none> and password file <none>
I20260807 04:59:38.539048 27647 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:38.539108 27647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:38.539273 27647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:38.541363 27647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "b85894227ada4befa5609006f1aed43a"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "c245d598c67e22085827afaa2092ff24"
server_key_iv: "220b20d21c506e68f84f2169d9d41e43"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.541862 27647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "b85894227ada4befa5609006f1aed43a"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "c245d598c67e22085827afaa2092ff24"
server_key_iv: "220b20d21c506e68f84f2169d9d41e43"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.545243 27647 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:59:38.547447 27673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.548630 27647 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:38.548725 27647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "b85894227ada4befa5609006f1aed43a"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "c245d598c67e22085827afaa2092ff24"
server_key_iv: "220b20d21c506e68f84f2169d9d41e43"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.548833 27647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:38.561399 27647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:38.564442 27647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:38.564620 27647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:38.565171 27647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:38.565973 27647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:38.566020 27647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.566062 27647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:38.566092 27647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.574960 27647 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:38457
I20260807 04:59:38.574980 27843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:38457 every 8 connection(s)
I20260807 04:59:38.575969 27647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:38.584798 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27647
I20260807 04:59:38.584906 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:38.585165 26459 external_mini_cluster.cc:1428] Setting key e86fffb2ec540822720d85800ab8d50e
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:38.589756 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.578030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:58187 (local address 127.25.214.254:35585)
0807 04:59:38.578179 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.578184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.579316 (+ 1132us) server_negotiation.cc:407] Connection header received
0807 04:59:38.580301 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.580306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.580368 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.580444 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:38.581660 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.582194 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.583327 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.583555 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.583643 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.586221 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:38.586225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:38.586228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:38.586251 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:38.587572 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.588163 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.588166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.588167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.588238 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.588606 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.588609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.588610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.588845 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:38.588942 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.589455 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.589591 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:59:38.590559 27846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.578559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35585 (local address 127.25.214.194:58187)
0807 04:59:38.579152 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:38.579200 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:38.580047 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:38.580629 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:38.580636 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:38.581008 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:38.581503 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.581517 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.582317 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.582320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.583205 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.583214 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.583701 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.583705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.583871 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.584429 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:38.584445 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:38.586057 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:38.587688 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:38.587695 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:38.587712 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:38.588047 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:38.588314 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:38.588317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:38.588319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:38.588506 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:38.588946 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:38.588952 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:38.589213 (+ 261us) client_negotiation.cc:769] Sending connection context
0807 04:59:38.589371 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 04:59:38.589649 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":144,"threads_started":1}
I20260807 04:59:38.591754 27844 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35585
I20260807 04:59:38.592044 27844 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:38.592696 27844 heartbeater.cc:511] Master 127.25.214.254:35585 requested a full tablet report, sending...
I20260807 04:59:38.593892 27336 ts_manager.cc:194] Registered new tserver with Master: b85894227ada4befa5609006f1aed43a (127.25.214.194:38457)
I20260807 04:59:38.594470 27336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:58187
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:38.615140 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35585
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:36361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:38.726310 27852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:38.726559 27852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:38.726619 27852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:38.730520 27852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:38.730579 27852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:38.730656 27852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:38.735759 27852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35585
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:38.736766 27852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:38.737746 27852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 04:59:38.747051 27852 server_base.cc:1034] running on GCE node
W20260807 04:59:38.746994 27864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:38.747007 27862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:38.746994 27860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:38.747730 27852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:38.748394 27852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:38.749545 27852 hybrid_clock.cc:648] HybridClock initialized: now 1786078778749528 us; error 29 us; skew 500 ppm
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:38.752310 27852 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:38.753314 27852 webserver.cc:460] Webserver started at http://127.25.214.195:44515/ using document root <none> and password file <none>
I20260807 04:59:38.753927 27852 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:38.753995 27852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:38.754184 27852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:38.756366 27852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "29e09eb2671e46f4bc1b9e1546a99599"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "3b915405c8ad00cf09cce5dbb5fc6564"
server_key_iv: "a732948badb196bd6f1c390d9fc02e37"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.756907 27852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "29e09eb2671e46f4bc1b9e1546a99599"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "3b915405c8ad00cf09cce5dbb5fc6564"
server_key_iv: "a732948badb196bd6f1c390d9fc02e37"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.760532 27852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:59:38.762796 27877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.763917 27852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:38.764014 27852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "29e09eb2671e46f4bc1b9e1546a99599"
format_stamp: "Formatted at 2026-08-07 04:59:38 on dist-test-slave-lgr5"
server_key: "3b915405c8ad00cf09cce5dbb5fc6564"
server_key_iv: "a732948badb196bd6f1c390d9fc02e37"
server_key_version: "encryptionkey@0"
I20260807 04:59:38.764137 27852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:38.782011 27852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:38.784543 27852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:38.784690 27852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:38.785200 27852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:38.785938 27852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:38.785982 27852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.786021 27852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:38.786049 27852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:38.794351 27852 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:36719
I20260807 04:59:38.794385 28058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:36719 every 8 connection(s)
I20260807 04:59:38.795285 27852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 04:59:38.801725 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27852
I20260807 04:59:38.801852 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:38.802114 26459 external_mini_cluster.cc:1428] Setting key 11bb7e2fe2872ae523e6cff19fd64f4e
Aug 07 04:59:38 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078778, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:38.808246 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.797172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:43179 (local address 127.25.214.254:35585)
0807 04:59:38.797307 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.797311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.798175 (+ 864us) server_negotiation.cc:407] Connection header received
0807 04:59:38.799086 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.799090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.799150 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.799227 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:38.800465 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.801000 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.802226 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.802506 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.802616 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.805255 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:38.805259 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:38.805261 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:38.805286 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:38.806594 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.806997 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.806999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.807000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.807068 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.807317 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.807319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.807320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.807486 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:38.807565 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.807993 (+ 428us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.808118 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 04:59:38.809119 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.797536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35585 (local address 127.25.214.195:43179)
0807 04:59:38.798019 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:38.798070 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:38.798875 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:38.799406 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:38.799413 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:38.799785 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:38.800317 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.800332 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.801128 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.801132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.802111 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.802123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.802792 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.802794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.802955 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.803618 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:38.803635 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:38.805104 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:38.806681 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:38.806684 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:38.806696 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:38.806927 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:38.807129 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:38.807131 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:38.807132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:38.807252 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:38.807565 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:38.807571 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:38.807807 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 04:59:38.807959 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 04:59:38.808267 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":121,"threads_started":1}
I20260807 04:59:38.810199 28059 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35585
I20260807 04:59:38.810439 28059 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:38.810932 28059 heartbeater.cc:511] Master 127.25.214.254:35585 requested a full tablet report, sending...
I20260807 04:59:38.811923 27336 ts_manager.cc:194] Registered new tserver with Master: 29e09eb2671e46f4bc1b9e1546a99599 (127.25.214.195:36719)
I20260807 04:59:38.812498 27336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:43179
I20260807 04:59:38.815937 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:59:38.826715 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.820205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39496 (local address 127.25.214.254:35585)
0807 04:59:38.820344 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.820349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.820481 (+ 132us) server_negotiation.cc:407] Connection header received
0807 04:59:38.820609 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.820611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.820655 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.820711 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:38.821342 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.821841 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.822574 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.822771 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.822836 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.824016 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:38.824019 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:38.824021 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:38.824054 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:38.825367 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.825734 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.825736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.825738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.825804 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:38.825978 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:38.825980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:38.825981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:38.826198 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:38.826297 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.826466 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.826557 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 04:59:38.832732 27336 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:59:38.836301 27336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:38.853935 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.847174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:36719 (local address 127.0.0.1:43738)
0807 04:59:38.847671 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:38.847730 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:38.847874 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:38.848751 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:38.848757 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:38.848782 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:38.848965 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.848973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.850387 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.850391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.852100 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.852112 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.853236 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.853240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.853419 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.853532 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 04:59:38.853632 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 04:59:38.853800 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":196,"thread_start_us":108,"threads_started":1}
I20260807 04:59:38.853943 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.847328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43738 (local address 127.25.214.195:36719)
0807 04:59:38.848239 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.848251 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.848276 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:59:38.848353 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.848359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.848577 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.849139 (+ 562us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:38.849294 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.850262 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.852214 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.853093 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.853333 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.853434 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.853682 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.853787 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":805,"thread_start_us":122,"threads_started":1}
I20260807 04:59:38.853942 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.848414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35248 (local address 127.25.214.193:45591)
0807 04:59:38.848779 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.848795 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.849046 (+ 251us) server_negotiation.cc:407] Connection header received
0807 04:59:38.849280 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.849285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.849472 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.849636 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:38.849903 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.850784 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.852260 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.853050 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.853160 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.853349 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.853703 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.853793 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":118,"threads_started":1}
I20260807 04:59:38.854199 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.848023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36510 (local address 127.25.214.194:38457)
0807 04:59:38.848468 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:38.848480 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:38.848502 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:59:38.848596 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:38.848601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:38.848779 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:38.848940 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:38.849139 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.850256 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.852023 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.852974 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.853112 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.853349 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:38.853957 (+ 608us) server_negotiation.cc:299] Negotiation successful
0807 04:59:38.854068 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":139,"threads_started":1}
I20260807 04:59:38.854411 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.847943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:45591 (local address 127.0.0.1:35248)
0807 04:59:38.848945 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:38.848958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:38.849123 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:38.849624 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:38.849628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:38.849648 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:38.849747 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.849754 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.850928 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.850931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.852131 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.852139 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.853416 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.853419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.853555 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.853573 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 04:59:38.854179 (+ 606us) client_negotiation.cc:240] Negotiation successful
0807 04:59:38.854254 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"mutex_wait_us":22,"thread_start_us":138,"threads_started":1}
I20260807 04:59:38.854601 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:38.847272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:38457 (local address 127.0.0.1:36510)
0807 04:59:38.848200 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:38.848213 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:38.848302 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:38.848915 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:38.848917 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:38.848930 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:38.849050 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.849056 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.850421 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.850424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.851905 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:38.851915 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:38.853115 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:38.853119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:38.853457 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:38.853530 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 04:59:38.853640 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 04:59:38.853766 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":182,"thread_start_us":97,"threads_started":1}
I20260807 04:59:38.857393 27949 tablet_service.cc:1467] Processing CreateTablet for tablet 88dea3f134ff41dda6ff9c680648c772 (DEFAULT_TABLE table=test-table [id=0f9fb116c38347bc919bc5203dd30b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:38.858762 27949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88dea3f134ff41dda6ff9c680648c772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:38.859175 27536 tablet_service.cc:1467] Processing CreateTablet for tablet 88dea3f134ff41dda6ff9c680648c772 (DEFAULT_TABLE table=test-table [id=0f9fb116c38347bc919bc5203dd30b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:38.859179 27742 tablet_service.cc:1467] Processing CreateTablet for tablet 88dea3f134ff41dda6ff9c680648c772 (DEFAULT_TABLE table=test-table [id=0f9fb116c38347bc919bc5203dd30b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:38.860209 27742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88dea3f134ff41dda6ff9c680648c772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:38.860356 27536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88dea3f134ff41dda6ff9c680648c772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:38.866323 28089 tablet_bootstrap.cc:492] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: Bootstrap starting.
I20260807 04:59:38.868144 28091 tablet_bootstrap.cc:492] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: Bootstrap starting.
I20260807 04:59:38.868427 28090 tablet_bootstrap.cc:492] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: Bootstrap starting.
I20260807 04:59:38.869457 28089 tablet_bootstrap.cc:654] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:38.870157 28091 tablet_bootstrap.cc:654] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:38.870515 28090 tablet_bootstrap.cc:654] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:38.871107 28089 log.cc:824] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:38.871380 28091 log.cc:824] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:38.871639 28090 log.cc:824] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:38.873324 28089 tablet_bootstrap.cc:492] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: No bootstrap required, opened a new log
I20260807 04:59:38.873522 28089 ts_tablet_manager.cc:1397] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 04:59:38.873540 28091 tablet_bootstrap.cc:492] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: No bootstrap required, opened a new log
I20260807 04:59:38.873708 28090 tablet_bootstrap.cc:492] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: No bootstrap required, opened a new log
I20260807 04:59:38.873719 28091 ts_tablet_manager.cc:1397] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 04:59:38.873876 28090 ts_tablet_manager.cc:1397] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 04:59:38.876600 28089 raft_consensus.cc:348] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:38.877022 28089 raft_consensus.cc:374] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:38.877141 28089 raft_consensus.cc:729] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85894227ada4befa5609006f1aed43a, State: Initialized, Role: FOLLOWER
I20260807 04:59:38.877564 28091 raft_consensus.cc:348] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:38.877556 28090 raft_consensus.cc:348] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:38.877736 28089 consensus_queue.cc:260] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:38.877815 28091 raft_consensus.cc:374] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:38.877815 28090 raft_consensus.cc:374] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:38.877868 28091 raft_consensus.cc:729] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f226a6f0ef7b4046ac40df2b91228508, State: Initialized, Role: FOLLOWER
I20260807 04:59:38.877868 28090 raft_consensus.cc:729] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29e09eb2671e46f4bc1b9e1546a99599, State: Initialized, Role: FOLLOWER
I20260807 04:59:38.878304 28091 consensus_queue.cc:260] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:38.878304 28090 consensus_queue.cc:260] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:38.878633 27844 heartbeater.cc:503] Master 127.25.214.254:35585 was elected leader, sending a full tablet report...
I20260807 04:59:38.878854 28089 ts_tablet_manager.cc:1428] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260807 04:59:38.879048 27639 heartbeater.cc:503] Master 127.25.214.254:35585 was elected leader, sending a full tablet report...
I20260807 04:59:38.879326 28091 ts_tablet_manager.cc:1428] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 04:59:38.880352 28059 heartbeater.cc:503] Master 127.25.214.254:35585 was elected leader, sending a full tablet report...
I20260807 04:59:38.880602 28090 ts_tablet_manager.cc:1428] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
W20260807 04:59:39.046536 28060 tablet.cc:2369] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:59:39.077260 27845 tablet.cc:2369] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:59:39.121901 27642 tablet.cc:2369] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:59:39.201100 28097 raft_consensus.cc:482] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:39.201375 28097 raft_consensus.cc:504] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:39.202620 28097 leader_election.cc:288] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29e09eb2671e46f4bc1b9e1546a99599 (127.25.214.195:36719), f226a6f0ef7b4046ac40df2b91228508 (127.25.214.193:45591)
I20260807 04:59:39.206408 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.202998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:35657 (local address 127.25.214.195:36719)
0807 04:59:39.203124 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.203128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.203204 (+ 76us) server_negotiation.cc:407] Connection header received
0807 04:59:39.203385 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.203388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.203441 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.203530 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:39.203850 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.204447 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.205484 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.205893 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.205999 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.206055 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.206226 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.206290 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 04:59:39.206420 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.202879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:36719 (local address 127.25.214.194:35657)
0807 04:59:39.203125 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:39.203140 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:39.203256 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:39.203600 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:39.203603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:39.203624 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:39.203743 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.203748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.204554 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.204557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.205359 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.205368 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.205999 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.206003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.206108 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.206132 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 04:59:39.206200 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 04:59:39.206269 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":77,"threads_started":1}
I20260807 04:59:39.206543 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.203400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:59773 (local address 127.25.214.193:45591)
0807 04:59:39.203530 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.203534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.203672 (+ 138us) server_negotiation.cc:407] Connection header received
0807 04:59:39.203766 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.203769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.203815 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.203881 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:39.204173 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.204655 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.205641 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.206011 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.206121 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.206171 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.206356 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.206420 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:59:39.206573 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.203266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:45591 (local address 127.25.214.194:59773)
0807 04:59:39.203572 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:39.203583 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:39.203681 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:39.203897 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:39.203899 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:39.203914 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:39.204055 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.204063 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.204761 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.204765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.205514 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.205523 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.206128 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.206132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.206238 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.206264 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 04:59:39.206329 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 04:59:39.206395 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":1,"thread_start_us":103,"threads_started":1}
I20260807 04:59:39.207401 27980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88dea3f134ff41dda6ff9c680648c772" candidate_uuid: "b85894227ada4befa5609006f1aed43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29e09eb2671e46f4bc1b9e1546a99599" is_pre_election: true
I20260807 04:59:39.207795 27980 raft_consensus.cc:2454] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85894227ada4befa5609006f1aed43a in term 0.
I20260807 04:59:39.208277 28098 raft_consensus.cc:482] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:39.208330 27674 leader_election.cc:302] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29e09eb2671e46f4bc1b9e1546a99599, b85894227ada4befa5609006f1aed43a; no voters:
I20260807 04:59:39.208588 28097 raft_consensus.cc:2781] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:39.208642 28097 raft_consensus.cc:482] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:39.208666 28097 raft_consensus.cc:3037] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:39.208513 28098 raft_consensus.cc:504] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:39.209682 28097 raft_consensus.cc:504] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:39.209965 28097 leader_election.cc:288] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [CANDIDATE]: Term 1 election: Requested vote from peers 29e09eb2671e46f4bc1b9e1546a99599 (127.25.214.195:36719), f226a6f0ef7b4046ac40df2b91228508 (127.25.214.193:45591)
I20260807 04:59:39.210048 28098 leader_election.cc:288] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29e09eb2671e46f4bc1b9e1546a99599 (127.25.214.195:36719), b85894227ada4befa5609006f1aed43a (127.25.214.194:38457)
I20260807 04:59:39.210182 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88dea3f134ff41dda6ff9c680648c772" candidate_uuid: "b85894227ada4befa5609006f1aed43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226a6f0ef7b4046ac40df2b91228508" is_pre_election: true
I20260807 04:59:39.210428 27567 raft_consensus.cc:2454] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85894227ada4befa5609006f1aed43a in term 0.
I20260807 04:59:39.210675 27566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88dea3f134ff41dda6ff9c680648c772" candidate_uuid: "b85894227ada4befa5609006f1aed43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f226a6f0ef7b4046ac40df2b91228508"
I20260807 04:59:39.210793 27566 raft_consensus.cc:3037] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:39.210819 27980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88dea3f134ff41dda6ff9c680648c772" candidate_uuid: "b85894227ada4befa5609006f1aed43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29e09eb2671e46f4bc1b9e1546a99599"
I20260807 04:59:39.210958 27980 raft_consensus.cc:3037] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:39.212205 27566 raft_consensus.cc:2454] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85894227ada4befa5609006f1aed43a in term 1.
I20260807 04:59:39.212316 27980 raft_consensus.cc:2454] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85894227ada4befa5609006f1aed43a in term 1.
I20260807 04:59:39.212622 27674 leader_election.cc:302] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b85894227ada4befa5609006f1aed43a, f226a6f0ef7b4046ac40df2b91228508; no voters:
I20260807 04:59:39.212927 28097 raft_consensus.cc:2781] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:39.213163 28097 raft_consensus.cc:686] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [term 1 LEADER]: Becoming Leader. State: Replica: b85894227ada4befa5609006f1aed43a, State: Running, Role: LEADER
I20260807 04:59:39.213574 28097 consensus_queue.cc:237] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } }
I20260807 04:59:39.214685 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.210187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:42227 (local address 127.25.214.195:36719)
0807 04:59:39.210288 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.210291 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.210580 (+ 289us) server_negotiation.cc:407] Connection header received
0807 04:59:39.210762 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.210765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.210817 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.210865 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:39.211292 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.211992 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.213547 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.214116 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.214233 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.214287 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.214483 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.214566 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 04:59:39.214694 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.209844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:36719 (local address 127.25.214.193:42227)
0807 04:59:39.210496 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:39.210508 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:39.210645 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:39.211012 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:39.211015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:39.211032 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:39.211164 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.211172 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.212190 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.212193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.213410 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.213421 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.214233 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.214237 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.214340 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.214369 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 04:59:39.214454 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 04:59:39.214532 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":89,"threads_started":1}
I20260807 04:59:39.214937 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.210836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:40981 (local address 127.25.214.194:38457)
0807 04:59:39.210948 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.210952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.210966 (+ 14us) server_negotiation.cc:407] Connection header received
0807 04:59:39.211009 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.211012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.211072 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.211147 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:39.211875 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.212576 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.213736 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.214312 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.214385 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.214418 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.214751 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.214826 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 04:59:39.215348 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.209832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:38457 (local address 127.25.214.193:40981)
0807 04:59:39.210265 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:39.210280 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:39.210376 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:39.211603 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:39.211606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:39.211625 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:39.211745 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.211752 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.212709 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.212712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.213592 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:39.213602 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.214509 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.214512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:39.214609 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.214631 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 04:59:39.215137 (+ 506us) client_negotiation.cc:240] Negotiation successful
0807 04:59:39.215212 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":99,"threads_started":1}
I20260807 04:59:39.215448 27980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88dea3f134ff41dda6ff9c680648c772" candidate_uuid: "f226a6f0ef7b4046ac40df2b91228508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29e09eb2671e46f4bc1b9e1546a99599" is_pre_election: true
I20260807 04:59:39.215656 27980 raft_consensus.cc:2379] T 88dea3f134ff41dda6ff9c680648c772 P 29e09eb2671e46f4bc1b9e1546a99599 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f226a6f0ef7b4046ac40df2b91228508 in current term 1: Already voted for candidate b85894227ada4befa5609006f1aed43a in this term.
I20260807 04:59:39.215909 27772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88dea3f134ff41dda6ff9c680648c772" candidate_uuid: "f226a6f0ef7b4046ac40df2b91228508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85894227ada4befa5609006f1aed43a" is_pre_election: true
I20260807 04:59:39.216602 27462 leader_election.cc:302] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f226a6f0ef7b4046ac40df2b91228508; no voters: 29e09eb2671e46f4bc1b9e1546a99599, b85894227ada4befa5609006f1aed43a
I20260807 04:59:39.217099 28098 raft_consensus.cc:2726] T 88dea3f134ff41dda6ff9c680648c772 P f226a6f0ef7b4046ac40df2b91228508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 04:59:39.217705 27335 catalog_manager.cc:5495] T 88dea3f134ff41dda6ff9c680648c772 P b85894227ada4befa5609006f1aed43a reported cstate change: term changed from 0 to 1, leader changed from <none> to b85894227ada4befa5609006f1aed43a (127.25.214.194). New cstate: current_term: 1 leader_uuid: "b85894227ada4befa5609006f1aed43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29e09eb2671e46f4bc1b9e1546a99599" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 36719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85894227ada4befa5609006f1aed43a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f226a6f0ef7b4046ac40df2b91228508" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45591 } health_report { overall_health: UNKNOWN } } }
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:39.310786 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.298279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35254 (local address 127.25.214.193:45591)
0807 04:59:39.298447 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.298451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.298526 (+ 75us) server_negotiation.cc:407] Connection header received
0807 04:59:39.298643 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.298646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.298688 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.298756 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:39.299396 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.299896 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.300688 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.300894 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.300968 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.307488 (+ 6520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:39.307503 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:39.307520 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:39.307550 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:39.309082 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:39.309476 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:39.309481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:39.309482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:39.309563 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:39.309837 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:39.309839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:39.309840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:39.310110 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:39.310312 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.310505 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.310625 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:39.337879 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.330061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35262 (local address 127.25.214.193:45591)
0807 04:59:39.330216 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.330221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.330338 (+ 117us) server_negotiation.cc:407] Connection header received
0807 04:59:39.330480 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.330483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.330528 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.330600 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:39.331257 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.331776 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.332617 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.332841 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.332929 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.335168 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:39.335171 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:39.335173 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:39.335198 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:39.336556 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:39.336898 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:39.336900 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:39.336901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:39.336967 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:39.337146 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:39.337148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:39.337149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:39.337322 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:39.337420 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.337649 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.337752 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[27269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[27269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:39.365706 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:39.357618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35266 (local address 127.25.214.193:45591)
0807 04:59:39.357767 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:39.357773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:39.357887 (+ 114us) server_negotiation.cc:407] Connection header received
0807 04:59:39.358012 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:39.358014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:39.358062 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:39.358137 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:39.358793 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.359373 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.360187 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:39.360414 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:39.360493 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:39.362825 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:39.362829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:39.362831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:39.362861 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:39.364168 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:39.364580 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:39.364583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:39.364585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:39.364669 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:39.364908 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:39.364912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:39.364913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:39.365107 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:39.365219 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:39.365403 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 04:59:39.365513 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 04:59:39.367501 27505 tablet_service.cc:2908] Rejecting scan request for tablet 88dea3f134ff41dda6ff9c680648c772: Uninitialized: clean time has not yet been initialized
I20260807 04:59:39.369856 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27427
I20260807 04:59:39.387306 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27647
I20260807 04:59:39.399077 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27852
I20260807 04:59:39.413275 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27288
2026-08-07T04:59:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2807 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[28129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[28129](info): set up 2 sockets
Aug 07 04:59:39 dist-test-slave-lgr5 krb5kdc[28129](info): commencing operation
krb5kdc: starting...
W20260807 04:59:40.561882 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:40 dist-test-slave-lgr5 krb5kdc[28129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:40.680621 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40867
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:40867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:40.790588 28151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:40.790863 28151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:40.790920 28151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:40.794904 28151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:40.794982 28151 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 04:59:40.795006 28151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:40.795029 28151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:40.795051 28151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:40.795089 28151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:40.800405 28151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:40867
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:40.801451 28151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:40.802441 28151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:40.810658 28163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:40.810655 28159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:40.810655 28160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:40.811038 28151 server_base.cc:1034] running on GCE node
I20260807 04:59:40.811606 28151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:40.812774 28151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:40.813938 28151 hybrid_clock.cc:648] HybridClock initialized: now 1786078780813922 us; error 35 us; skew 500 ppm
Aug 07 04:59:40 dist-test-slave-lgr5 krb5kdc[28129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078780, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:40.816695 28151 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:40.817565 28151 webserver.cc:460] Webserver started at http://127.25.214.254:45469/ using document root <none> and password file <none>
I20260807 04:59:40.818099 28151 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:40.818154 28151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:40.818320 28151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:40.820402 28151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "0585c8ad38b24c6eb5f43a55e53439df"
format_stamp: "Formatted at 2026-08-07 04:59:40 on dist-test-slave-lgr5"
server_key: "df057c89a868c4a9725acf8b49035245"
server_key_iv: "960f4a5772f3adbe0b1a1d157cf64e57"
server_key_version: "encryptionkey@0"
I20260807 04:59:40.820924 28151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "0585c8ad38b24c6eb5f43a55e53439df"
format_stamp: "Formatted at 2026-08-07 04:59:40 on dist-test-slave-lgr5"
server_key: "df057c89a868c4a9725acf8b49035245"
server_key_iv: "960f4a5772f3adbe0b1a1d157cf64e57"
server_key_version: "encryptionkey@0"
I20260807 04:59:40.824488 28151 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:40.826807 28175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:40.828074 28151 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:40.828256 28151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "0585c8ad38b24c6eb5f43a55e53439df"
format_stamp: "Formatted at 2026-08-07 04:59:40 on dist-test-slave-lgr5"
server_key: "df057c89a868c4a9725acf8b49035245"
server_key_iv: "960f4a5772f3adbe0b1a1d157cf64e57"
server_key_version: "encryptionkey@0"
I20260807 04:59:40.828361 28151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:40.842536 28151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:40.845687 28151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:40.845870 28151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:40.853974 28151 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:40867
I20260807 04:59:40.853987 28275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:40867 every 8 connection(s)
I20260807 04:59:40.854979 28151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:40.856770 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28151
I20260807 04:59:40.856869 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:40.857121 26459 external_mini_cluster.cc:1428] Setting key f52f56a38242ee835870e5a16329786f
I20260807 04:59:40.857949 28276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:40.864583 28276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: Bootstrap starting.
Aug 07 04:59:40 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:40.866848 28276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:40.868316 28276 log.cc:824] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:40.870597 28276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: No bootstrap required, opened a new log
I20260807 04:59:40.871287 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:40.858486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57032 (local address 127.25.214.254:40867)
0807 04:59:40.858915 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:40.858934 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:40.858977 (+ 43us) server_negotiation.cc:407] Connection header received
0807 04:59:40.859802 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:40.859824 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:40.860247 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:40.860617 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:40.861230 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:40.862703 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:40.863482 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:40.864188 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:40.864343 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:40.866588 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:40.866594 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:40.866609 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:40.866639 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:40.868521 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:40.868939 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:40.868946 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:40.868952 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:40.869106 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:40.869407 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:40.869409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:40.869410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:40.869797 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:40.869931 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:40.870245 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 04:59:40.870519 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":117,"threads_started":1}
I20260807 04:59:40.873893 28276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0585c8ad38b24c6eb5f43a55e53439df" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40867 } }
I20260807 04:59:40.874114 28276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:40.874173 28276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0585c8ad38b24c6eb5f43a55e53439df, State: Initialized, Role: FOLLOWER
I20260807 04:59:40.874562 28276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0585c8ad38b24c6eb5f43a55e53439df" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40867 } }
I20260807 04:59:40.874699 28276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:40.874763 28276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:40.874861 28276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:40.875814 28276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0585c8ad38b24c6eb5f43a55e53439df" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40867 } }
I20260807 04:59:40.876157 28276 leader_election.cc:302] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0585c8ad38b24c6eb5f43a55e53439df; no voters:
I20260807 04:59:40.876469 28276 leader_election.cc:288] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:40.876570 28282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:40.876767 28282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [term 1 LEADER]: Becoming Leader. State: Replica: 0585c8ad38b24c6eb5f43a55e53439df, State: Running, Role: LEADER
I20260807 04:59:40.877082 28282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0585c8ad38b24c6eb5f43a55e53439df" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40867 } }
I20260807 04:59:40.877594 28276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:40.878608 28284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0585c8ad38b24c6eb5f43a55e53439df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0585c8ad38b24c6eb5f43a55e53439df" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40867 } } }
I20260807 04:59:40.878978 28284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:40.878867 28285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0585c8ad38b24c6eb5f43a55e53439df. Latest consensus state: current_term: 1 leader_uuid: "0585c8ad38b24c6eb5f43a55e53439df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0585c8ad38b24c6eb5f43a55e53439df" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40867 } } }
I20260807 04:59:40.879151 28285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df [sys.catalog]: This master's current role is: LEADER
W20260807 04:59:40.881906 28307 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:59:40.881969 28307 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:59:40.882048 28302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:40.882715 28302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:40.887805 28302 catalog_manager.cc:1347] Generated new cluster ID: dd1b1b8411004946a23ca8583a67f1a4
I20260807 04:59:40.887871 28302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:40.900501 28302 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:40.901757 28302 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:40.909054 28302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: Generated new TSK 0
I20260807 04:59:40.909834 28302 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:40.944218 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40867
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:41.061969 28318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:41.062242 28318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:41.062292 28318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:41.066278 28318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:41.066340 28318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:41.066386 28318 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:59:41.066439 28318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:41.071818 28318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:40867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:41.073047 28318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:41.074101 28318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:41.083688 28328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:41.083714 28326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:41.083884 28318 server_base.cc:1034] running on GCE node
W20260807 04:59:41.083714 28325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:41.084408 28318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:41.085060 28318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:41.086225 28318 hybrid_clock.cc:648] HybridClock initialized: now 1786078781086206 us; error 28 us; skew 500 ppm
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:41.089044 28318 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:41.089979 28318 webserver.cc:460] Webserver started at http://127.25.214.193:41067/ using document root <none> and password file <none>
I20260807 04:59:41.090560 28318 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:41.090621 28318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:41.090804 28318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:41.093158 28318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "e81a9cb90c624c909b18b333b7a3eac8"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "41c59bc0959887ae9ca673ce620163f6"
server_key_iv: "6ead813df777a7805cf1259304e04d0b"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.093724 28318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "e81a9cb90c624c909b18b333b7a3eac8"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "41c59bc0959887ae9ca673ce620163f6"
server_key_iv: "6ead813df777a7805cf1259304e04d0b"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.097543 28318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:41.100023 28339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:41.101343 28318 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:41.101454 28318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "e81a9cb90c624c909b18b333b7a3eac8"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "41c59bc0959887ae9ca673ce620163f6"
server_key_iv: "6ead813df777a7805cf1259304e04d0b"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.101550 28318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:41.115310 28318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:41.118577 28318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:41.118737 28318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:41.120224 28318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:41.120280 28318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:41.120339 28318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:41.120368 28318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:41.130656 28318 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:34977
I20260807 04:59:41.130698 28526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:34977 every 8 connection(s)
I20260807 04:59:41.131657 28318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:41.133667 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.121052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:41583 (local address 127.25.214.254:40867)
0807 04:59:41.121204 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.121209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.122039 (+ 830us) server_negotiation.cc:407] Connection header received
0807 04:59:41.123188 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.123191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.123257 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.123373 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.124714 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.125542 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.126868 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.127111 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.127200 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.129824 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.129827 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.129829 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.129854 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.131437 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.132026 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.132030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.132033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.132186 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.132624 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.132628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.132630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.132857 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.132949 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.133417 (+ 468us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.133541 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:59:41.134413 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.121430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.25.214.193:41583)
0807 04:59:41.121886 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.121936 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.122912 (+ 976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.123562 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.123571 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.123977 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:41.124571 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.124587 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.125679 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.125682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.126753 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.126764 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.127279 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.127284 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.127445 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.128048 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:41.128065 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:41.129657 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:41.131550 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.131555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.131569 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.131926 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.132304 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.132307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.132309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.132516 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.132960 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:41.132965 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:41.133183 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.133332 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.133602 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":108,"threads_started":1}
I20260807 04:59:41.135667 28529 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40867
I20260807 04:59:41.135812 28529 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:41.136344 28529 heartbeater.cc:511] Master 127.25.214.254:40867 requested a full tablet report, sending...
I20260807 04:59:41.137806 28208 ts_manager.cc:194] Registered new tserver with Master: e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977)
I20260807 04:59:41.139400 28208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:41583
I20260807 04:59:41.140327 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28318
I20260807 04:59:41.140430 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:41.140723 26459 external_mini_cluster.cc:1428] Setting key 6befb1eabfb2ad84b68c59e4482b49dc
I20260807 04:59:41.144873 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.137828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:41925 (local address 127.25.214.254:40867)
0807 04:59:41.138001 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.138006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.138078 (+ 72us) server_negotiation.cc:407] Connection header received
0807 04:59:41.138158 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.138161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.138200 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.138280 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.138629 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.139407 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.140262 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.140558 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.140639 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.141838 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.141841 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.141843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.141865 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.143241 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.143676 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.143680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.143681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.143767 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.143994 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.143996 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.143998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.144226 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.144319 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.144610 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.144722 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 04:59:41.144879 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.137746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.25.214.193:41925)
0807 04:59:41.137991 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.138005 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.138097 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.138289 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.138291 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.138448 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:41.138542 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.138547 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.139539 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.139542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.140149 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.140160 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.140669 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.140672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.140761 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.141392 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:41.141403 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:41.141715 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:41.143348 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.143350 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.143352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.143588 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.143844 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.143846 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.143848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.143924 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.144304 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:41.144306 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:41.144393 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.144546 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.144689 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:41.167857 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40867
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:41.281647 28541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:41.281929 28541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:41.281997 28541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:41.286127 28541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:41.286201 28541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:41.286257 28541 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:59:41.286311 28541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:41.291756 28541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:40867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:41.292960 28541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:41.294003 28541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:41.303767 28556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:41.303851 28553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:41.303962 28541 server_base.cc:1034] running on GCE node
W20260807 04:59:41.303851 28551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:41.304425 28541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:41.305084 28541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:41.306242 28541 hybrid_clock.cc:648] HybridClock initialized: now 1786078781306219 us; error 40 us; skew 500 ppm
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:41.309149 28541 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:41.310021 28541 webserver.cc:460] Webserver started at http://127.25.214.194:37137/ using document root <none> and password file <none>
I20260807 04:59:41.310583 28541 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:41.310652 28541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:41.310858 28541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:41.312963 28541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "122f0db3363e4d88bba663463cefde9a"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "bb560ce34a865347eb251fb8b12bc7f4"
server_key_iv: "6bcd281aef6d31fa3f44f13af3c7b0d2"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.313553 28541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "122f0db3363e4d88bba663463cefde9a"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "bb560ce34a865347eb251fb8b12bc7f4"
server_key_iv: "6bcd281aef6d31fa3f44f13af3c7b0d2"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.317225 28541 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 04:59:41.319574 28567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:41.320793 28541 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:41.320917 28541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "122f0db3363e4d88bba663463cefde9a"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "bb560ce34a865347eb251fb8b12bc7f4"
server_key_iv: "6bcd281aef6d31fa3f44f13af3c7b0d2"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.321014 28541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:41.336951 28541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:41.340277 28541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:41.340449 28541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:41.342082 28541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:41.342139 28541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:41.342185 28541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:41.342212 28541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:41.352794 28541 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:34285
I20260807 04:59:41.352857 28746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:34285 every 8 connection(s)
I20260807 04:59:41.353920 28541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:41.354431 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28541
I20260807 04:59:41.354547 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:41.354858 26459 external_mini_cluster.cc:1428] Setting key 917c26c960ac796dc10f35929b01edde
I20260807 04:59:41.356691 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.342931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:39341 (local address 127.25.214.254:40867)
0807 04:59:41.343053 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.343057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.344335 (+ 1278us) server_negotiation.cc:407] Connection header received
0807 04:59:41.345525 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.345529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.345586 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.345646 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.347430 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.348210 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.349483 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.349717 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.349808 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.352586 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.352590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.352593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.352622 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.354172 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.354775 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.354780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.354781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.354876 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.355339 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.355343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.355344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.355559 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.355651 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.356372 (+ 721us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.356516 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 04:59:41.357563 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.343588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.25.214.194:39341)
0807 04:59:41.344178 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.344227 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.345218 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.346094 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.346103 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.346574 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:41.347267 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.347289 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.348330 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.348334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.349367 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.349378 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.349863 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.349867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.350055 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.350694 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:41.350713 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:41.352358 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:41.354299 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.354305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.354321 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.354682 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.355002 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.355005 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.355007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.355214 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.355721 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:41.355728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:41.356104 (+ 376us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.356335 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.356695 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":149,"threads_started":1}
I20260807 04:59:41.358986 28747 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40867
I20260807 04:59:41.359174 28747 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:41.359771 28747 heartbeater.cc:511] Master 127.25.214.254:40867 requested a full tablet report, sending...
I20260807 04:59:41.360890 28209 ts_manager.cc:194] Registered new tserver with Master: 122f0db3363e4d88bba663463cefde9a (127.25.214.194:34285)
I20260807 04:59:41.361617 28209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:39341
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 04:59:41.367933 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.361179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:58883 (local address 127.25.214.254:40867)
0807 04:59:41.361284 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.361288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.361548 (+ 260us) server_negotiation.cc:407] Connection header received
0807 04:59:41.361641 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.361644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.361692 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.361766 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.362338 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.362888 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.363685 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.363899 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.363983 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.365027 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.365030 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.365033 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.365065 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.366304 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.366729 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.366732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.366734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.366809 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.367079 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.367081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.367082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.367283 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.367370 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.367686 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.367785 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 04:59:41.367945 28760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.361133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.25.214.194:58883)
0807 04:59:41.361451 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.361465 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.361563 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.361883 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.361886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.362109 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:41.362229 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.362236 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.363017 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.363019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.363578 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.363586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.363997 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.364001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.364110 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.364585 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:41.364596 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:41.364897 (+ 301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:41.366405 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.366408 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.366411 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.366641 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.366890 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.366893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.366895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.366975 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.367409 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:41.367413 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:41.367502 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.367616 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.367763 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":108,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:41.384702 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40867
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:41.497116 28763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:41.497381 28763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:41.497427 28763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:41.501597 28763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:41.501669 28763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:41.501716 28763 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:59:41.501771 28763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:41.507349 28763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:40867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:41.508505 28763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:41.509521 28763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:41.519337 28772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:41.519345 28779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:41.519395 28763 server_base.cc:1034] running on GCE node
W20260807 04:59:41.519361 28776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:41.520012 28763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:41.520685 28763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:41.521868 28763 hybrid_clock.cc:648] HybridClock initialized: now 1786078781521845 us; error 31 us; skew 500 ppm
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:41.524714 28763 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:41.525720 28763 webserver.cc:460] Webserver started at http://127.25.214.195:37375/ using document root <none> and password file <none>
I20260807 04:59:41.526291 28763 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:41.526366 28763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:41.526594 28763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:41.528918 28763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "62691eb6b86041ef8be80d80faceb1e5"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "a6b13159db6b48e5eeeec01840296cad"
server_key_iv: "740c2e880dcdb66d5141897b462ebbb3"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.529464 28763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "62691eb6b86041ef8be80d80faceb1e5"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "a6b13159db6b48e5eeeec01840296cad"
server_key_iv: "740c2e880dcdb66d5141897b462ebbb3"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.533475 28763 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:41.536135 28788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:41.537420 28763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:41.537544 28763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "62691eb6b86041ef8be80d80faceb1e5"
format_stamp: "Formatted at 2026-08-07 04:59:41 on dist-test-slave-lgr5"
server_key: "a6b13159db6b48e5eeeec01840296cad"
server_key_iv: "740c2e880dcdb66d5141897b462ebbb3"
server_key_version: "encryptionkey@0"
I20260807 04:59:41.537647 28763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:41.567428 28763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:41.570796 28763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:41.570960 28763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:41.572508 28763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:41.572567 28763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:41.572623 28763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:41.572649 28763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:41.582816 28763 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:39857
I20260807 04:59:41.582880 28961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:39857 every 8 connection(s)
I20260807 04:59:41.583838 28763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 04:59:41.586190 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.573234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:57191 (local address 127.25.214.254:40867)
0807 04:59:41.573387 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.573392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.574336 (+ 944us) server_negotiation.cc:407] Connection header received
0807 04:59:41.575460 (+ 1124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.575464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.575526 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.575599 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.577374 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.578183 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.579901 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.580272 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.580390 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.582983 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.582987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.582990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.583019 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.584398 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.584970 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.584973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.584975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.585059 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.585305 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.585306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.585307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.585474 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.585542 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.585963 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.586071 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:59:41.587013 28802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.573676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.25.214.195:57191)
0807 04:59:41.574159 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.574212 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.575201 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.576038 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.576049 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.576499 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:41.577191 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.577213 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.578348 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.578352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.579768 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.579780 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.580421 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.580424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.580585 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.581217 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:41.581258 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:41.582777 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:41.584530 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.584550 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.584564 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.584879 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.585125 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.585127 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.585128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.585249 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.585552 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:41.585557 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:41.585776 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.585927 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.586171 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":117,"threads_started":1}
I20260807 04:59:41.588193 28962 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40867
I20260807 04:59:41.588338 28962 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:41.588845 28962 heartbeater.cc:511] Master 127.25.214.254:40867 requested a full tablet report, sending...
I20260807 04:59:41.589958 28208 ts_manager.cc:194] Registered new tserver with Master: 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857)
I20260807 04:59:41.590662 28208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:57191
I20260807 04:59:41.591629 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28763
I20260807 04:59:41.591729 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:41.591946 26459 external_mini_cluster.cc:1428] Setting key 8c9b1b73f14162cfc4c4ea326a034687
I20260807 04:59:41.593914 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:59:41.597589 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.590351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:44891 (local address 127.25.214.254:40867)
0807 04:59:41.590476 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.590481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.590681 (+ 200us) server_negotiation.cc:407] Connection header received
0807 04:59:41.590775 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.590778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.590827 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.590899 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.591417 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.592204 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.593207 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.593413 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.593496 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.594744 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.594747 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.594749 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.594773 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.596041 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.596469 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.596473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.596474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.596557 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.596803 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.596807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.596809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.596994 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.597080 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.597324 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.597430 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 04:59:41.597610 28969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.590269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.25.214.195:44891)
0807 04:59:41.590562 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.590578 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.590690 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.590936 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.590938 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.591175 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:41.591306 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.591314 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.592328 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.592332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.593105 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.593118 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.593522 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.593526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.593630 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.594169 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:41.594183 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:41.594596 (+ 413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:41.596169 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.596173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.596175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.596377 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.596638 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:41.596642 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:41.596643 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:41.596723 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:41.597082 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:41.597085 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:41.597177 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.597262 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.597421 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":121,"threads_started":1}
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:59:41 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:41.619890 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.612653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57046 (local address 127.25.214.254:40867)
0807 04:59:41.612768 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.612771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.612783 (+ 12us) server_negotiation.cc:407] Connection header received
0807 04:59:41.612825 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.612828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.612866 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.612933 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:41.613612 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.614112 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.614884 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.615099 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.615167 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.617486 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:41.617489 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:41.617491 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:41.617514 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:41.618643 (+ 1129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.618981 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.618984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.618985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.619049 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:41.619224 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:41.619225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:41.619226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:41.619385 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:41.619481 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.619635 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.619732 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 04:59:41.622686 28208 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:59:41.625761 28208 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:41.640138 28991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.634157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:34977 (local address 127.0.0.1:42602)
0807 04:59:41.635160 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.635211 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.635379 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.635861 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.635867 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.635890 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:41.636012 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.636020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.637335 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.637338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.638560 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.638569 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.639535 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.639538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.639644 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.639686 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.639795 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.639912 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260807 04:59:41.640264 28998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.633949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:34285 (local address 127.0.0.1:39496)
0807 04:59:41.635161 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.635211 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.635327 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.636174 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.636177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.636196 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:41.636287 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.636294 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.637648 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.637651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.638769 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.638779 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.639804 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.639808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.639890 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.639913 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.639989 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.640067 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1009,"thread_start_us":86,"threads_started":1}
I20260807 04:59:41.640275 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.634091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39496 (local address 127.25.214.194:34285)
0807 04:59:41.635798 (+ 1707us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.635806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.635824 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:59:41.635882 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.635886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.636013 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.636197 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:41.636413 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.637535 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.638905 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.639688 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.639817 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.639934 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.640013 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.640135 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1620,"thread_start_us":123,"threads_started":1}
I20260807 04:59:41.640537 28995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.634195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39857 (local address 127.0.0.1:45966)
0807 04:59:41.635491 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.635500 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.635591 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.636838 (+ 1247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.636841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.636857 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:41.636963 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.636970 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.638219 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.638223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.639184 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.639192 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.640174 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.640178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.640274 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.640299 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.640349 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.640409 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1250,"thread_start_us":90,"threads_started":1}
I20260807 04:59:41.640797 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.634742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42602 (local address 127.25.214.193:34977)
0807 04:59:41.635214 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.635220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.635299 (+ 79us) server_negotiation.cc:407] Connection header received
0807 04:59:41.635505 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.635511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.635730 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.635860 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:41.636139 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.637224 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.638674 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.639411 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.639543 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.639681 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.640332 (+ 651us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.640422 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":170,"threads_started":1}
I20260807 04:59:41.643486 28643 tablet_service.cc:1467] Processing CreateTablet for tablet 5a8bd0cfe3604bd2b54737d82faf1bef (DEFAULT_TABLE table=test-table [id=d425c7e7b856407eac30524bf31a3835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:41.643477 28423 tablet_service.cc:1467] Processing CreateTablet for tablet 5a8bd0cfe3604bd2b54737d82faf1bef (DEFAULT_TABLE table=test-table [id=d425c7e7b856407eac30524bf31a3835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:41.644677 28423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a8bd0cfe3604bd2b54737d82faf1bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:41.644677 28643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a8bd0cfe3604bd2b54737d82faf1bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:41.648213 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.634713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45966 (local address 127.25.214.195:39857)
0807 04:59:41.636471 (+ 1758us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.636479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.636496 (+ 17us) server_negotiation.cc:407] Connection header received
0807 04:59:41.636556 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.636560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.636704 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.636838 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:41.637070 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.638102 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.639290 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.639984 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.647808 (+ 7824us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.647920 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.647966 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.648045 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1669,"thread_start_us":126,"threads_started":1}
I20260807 04:59:41.650743 28861 tablet_service.cc:1467] Processing CreateTablet for tablet 5a8bd0cfe3604bd2b54737d82faf1bef (DEFAULT_TABLE table=test-table [id=d425c7e7b856407eac30524bf31a3835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:41.651666 28861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a8bd0cfe3604bd2b54737d82faf1bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:41.652189 29002 tablet_bootstrap.cc:492] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Bootstrap starting.
I20260807 04:59:41.653424 29003 tablet_bootstrap.cc:492] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Bootstrap starting.
I20260807 04:59:41.654516 29002 tablet_bootstrap.cc:654] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:41.655181 29003 tablet_bootstrap.cc:654] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:41.655957 29003 log.cc:824] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:41.655968 29002 log.cc:824] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:41.658034 29003 tablet_bootstrap.cc:492] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: No bootstrap required, opened a new log
I20260807 04:59:41.658109 29002 tablet_bootstrap.cc:492] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: No bootstrap required, opened a new log
I20260807 04:59:41.658244 29003 ts_tablet_manager.cc:1397] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 04:59:41.658309 29002 ts_tablet_manager.cc:1397] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 04:59:41.660456 29007 tablet_bootstrap.cc:492] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Bootstrap starting.
I20260807 04:59:41.661737 29003 raft_consensus.cc:348] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.662014 29003 raft_consensus.cc:374] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:41.662081 29003 raft_consensus.cc:729] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 122f0db3363e4d88bba663463cefde9a, State: Initialized, Role: FOLLOWER
I20260807 04:59:41.662122 29002 raft_consensus.cc:348] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.662361 29002 raft_consensus.cc:374] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:41.662411 29002 raft_consensus.cc:729] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81a9cb90c624c909b18b333b7a3eac8, State: Initialized, Role: FOLLOWER
I20260807 04:59:41.662570 29003 consensus_queue.cc:260] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.663038 29007 tablet_bootstrap.cc:654] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:41.663097 29002 consensus_queue.cc:260] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.663607 29003 ts_tablet_manager.cc:1428] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 04:59:41.663717 28529 heartbeater.cc:503] Master 127.25.214.254:40867 was elected leader, sending a full tablet report...
I20260807 04:59:41.663864 29007 log.cc:824] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:41.663933 28747 heartbeater.cc:503] Master 127.25.214.254:40867 was elected leader, sending a full tablet report...
I20260807 04:59:41.664615 29002 ts_tablet_manager.cc:1428] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260807 04:59:41.665719 29007 tablet_bootstrap.cc:492] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: No bootstrap required, opened a new log
I20260807 04:59:41.665887 29007 ts_tablet_manager.cc:1397] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 04:59:41.669148 29007 raft_consensus.cc:348] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.669380 29007 raft_consensus.cc:374] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:41.669437 29007 raft_consensus.cc:729] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62691eb6b86041ef8be80d80faceb1e5, State: Initialized, Role: FOLLOWER
I20260807 04:59:41.669864 29007 consensus_queue.cc:260] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.670506 28962 heartbeater.cc:503] Master 127.25.214.254:40867 was elected leader, sending a full tablet report...
I20260807 04:59:41.670810 29007 ts_tablet_manager.cc:1428] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260807 04:59:41.835090 28963 tablet.cc:2369] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:59:41.855911 28748 tablet.cc:2369] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:59:41.883119 28530 tablet.cc:2369] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:59:41.944355 29008 raft_consensus.cc:482] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:41.944624 29008 raft_consensus.cc:504] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.945847 29008 leader_election.cc:288] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977), 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857)
I20260807 04:59:41.949705 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.946248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:58097 (local address 127.25.214.193:34977)
0807 04:59:41.946375 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.946380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.946642 (+ 262us) server_negotiation.cc:407] Connection header received
0807 04:59:41.946764 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.946766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.946809 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.946870 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:41.947139 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.947639 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.948759 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.949175 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.949283 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.949339 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.949510 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.949578 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 04:59:41.949728 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.946244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:57929 (local address 127.25.214.195:39857)
0807 04:59:41.946376 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:41.946381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:41.946582 (+ 201us) server_negotiation.cc:407] Connection header received
0807 04:59:41.946729 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:41.946731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:41.946776 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:41.946839 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:41.947128 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.947639 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.948780 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.949179 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.949291 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.949345 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:41.949533 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 04:59:41.949604 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 04:59:41.949756 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.946151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39857 (local address 127.25.214.194:57929)
0807 04:59:41.946480 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.946492 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.946620 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.946866 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.946869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.946886 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:41.947015 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.947020 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.947753 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.947757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.948657 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.948667 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.949292 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.949296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.949421 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.949439 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.949505 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.949585 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":76,"spinlock_wait_cycles":15104,"thread_start_us":75,"threads_started":1}
I20260807 04:59:41.949929 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:41.946172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:34977 (local address 127.25.214.194:58097)
0807 04:59:41.946540 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:41.946552 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:41.946655 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:41.946893 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:41.946896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:41.946936 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:41.947034 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.947039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.947746 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.947749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.948635 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:41.948645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:41.949285 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:41.949289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:41.949396 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:41.949417 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 04:59:41.949481 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 04:59:41.949564 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":8,"spinlock_wait_cycles":768,"thread_start_us":82,"threads_started":1}
I20260807 04:59:41.950371 28892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a8bd0cfe3604bd2b54737d82faf1bef" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62691eb6b86041ef8be80d80faceb1e5" is_pre_election: true
I20260807 04:59:41.950582 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a8bd0cfe3604bd2b54737d82faf1bef" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81a9cb90c624c909b18b333b7a3eac8" is_pre_election: true
I20260807 04:59:41.950680 28892 raft_consensus.cc:2454] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 0.
I20260807 04:59:41.950855 28454 raft_consensus.cc:2454] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 0.
I20260807 04:59:41.951138 28572 leader_election.cc:302] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 122f0db3363e4d88bba663463cefde9a, 62691eb6b86041ef8be80d80faceb1e5; no voters:
I20260807 04:59:41.951412 29008 raft_consensus.cc:2781] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:41.951496 29008 raft_consensus.cc:482] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:41.951548 29008 raft_consensus.cc:3037] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:41.952689 29008 raft_consensus.cc:504] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.953015 29008 leader_election.cc:288] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 election: Requested vote from peers e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977), 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857)
I20260807 04:59:41.953384 28892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a8bd0cfe3604bd2b54737d82faf1bef" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62691eb6b86041ef8be80d80faceb1e5"
I20260807 04:59:41.953383 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a8bd0cfe3604bd2b54737d82faf1bef" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81a9cb90c624c909b18b333b7a3eac8"
I20260807 04:59:41.953516 28454 raft_consensus.cc:3037] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:41.953516 28892 raft_consensus.cc:3037] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:41.954881 28454 raft_consensus.cc:2454] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 1.
I20260807 04:59:41.955286 28575 leader_election.cc:302] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 122f0db3363e4d88bba663463cefde9a, e81a9cb90c624c909b18b333b7a3eac8; no voters:
I20260807 04:59:41.955483 29008 raft_consensus.cc:2781] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:41.955520 28892 raft_consensus.cc:2454] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 1.
I20260807 04:59:41.955679 29008 raft_consensus.cc:686] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 1 LEADER]: Becoming Leader. State: Replica: 122f0db3363e4d88bba663463cefde9a, State: Running, Role: LEADER
I20260807 04:59:41.956058 29008 consensus_queue.cc:237] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:41.959173 28208 catalog_manager.cc:5495] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 122f0db3363e4d88bba663463cefde9a (127.25.214.194). New cstate: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } health_report { overall_health: UNKNOWN } } }
I20260807 04:59:42.009626 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.006086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39510 (local address 127.25.214.194:34285)
0807 04:59:42.006233 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.006236 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.006252 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:59:42.006512 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.006516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.006578 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.006667 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:42.006893 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.007389 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.008235 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.008443 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.008510 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.008855 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.009296 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.009386 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.009451 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.009506 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:59:42.016338 28454 raft_consensus.cc:1261] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Refusing update from remote peer 122f0db3363e4d88bba663463cefde9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:42.017099 29008 consensus_queue.cc:1035] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:42.017413 28892 raft_consensus.cc:1261] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Refusing update from remote peer 122f0db3363e4d88bba663463cefde9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:42.017968 29008 consensus_queue.cc:1035] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:42.026613 29028 mvcc.cc:205] Tried to move back new op lower bound from 7315778691129958400 to 7315778690894700544. Current Snapshot: MvccSnapshot[applied={T|T < 7315778691129958400}]
I20260807 04:59:42.039016 28207 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:42.039250 28207 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:42.042138 28207 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: Sending DeleteTablet for 3 replicas of tablet 5a8bd0cfe3604bd2b54737d82faf1bef
I20260807 04:59:42.043227 28643 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a8bd0cfe3604bd2b54737d82faf1bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:39496
I20260807 04:59:42.043385 28423 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a8bd0cfe3604bd2b54737d82faf1bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42602
I20260807 04:59:42.043843 28861 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a8bd0cfe3604bd2b54737d82faf1bef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:45966
I20260807 04:59:42.044354 29040 tablet_replica.cc:330] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: stopping tablet replica
I20260807 04:59:42.044405 29038 tablet_replica.cc:330] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: stopping tablet replica
I20260807 04:59:42.044658 28207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 04:59:42.044751 29038 raft_consensus.cc:2229] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:59:42.044751 29040 raft_consensus.cc:2229] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 04:59:42.045120 28207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:42.045195 29038 raft_consensus.cc:2258] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:42.045524 29040 raft_consensus.cc:2258] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:42.045611 29039 tablet_replica.cc:330] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: stopping tablet replica
I20260807 04:59:42.045921 29039 raft_consensus.cc:2229] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:42.046198 29039 raft_consensus.cc:2258] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:42.047683 29040 ts_tablet_manager.cc:1905] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:42.049823 29038 ts_tablet_manager.cc:1905] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:42.050406 29040 ts_tablet_manager.cc:1918] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:59:42.050843 28423 tablet_service.cc:1467] Processing CreateTablet for tablet 8923dd9cd61a4a8393d526d1e19897f4 (DEFAULT_TABLE table=test-table [id=61b97633b1334cb9b4acf3a3b101f069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:42.051139 28423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8923dd9cd61a4a8393d526d1e19897f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:42.051110 28861 tablet_service.cc:1467] Processing CreateTablet for tablet 8923dd9cd61a4a8393d526d1e19897f4 (DEFAULT_TABLE table=test-table [id=61b97633b1334cb9b4acf3a3b101f069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:42.051353 28861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8923dd9cd61a4a8393d526d1e19897f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:42.052416 29038 ts_tablet_manager.cc:1918] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:59:42.052526 29038 log.cc:1196] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/5a8bd0cfe3604bd2b54737d82faf1bef
I20260807 04:59:42.052829 29038 ts_tablet_manager.cc:1939] T 5a8bd0cfe3604bd2b54737d82faf1bef P 122f0db3363e4d88bba663463cefde9a: Deleting consensus metadata
I20260807 04:59:42.053529 29007 tablet_bootstrap.cc:492] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Bootstrap starting.
I20260807 04:59:42.053761 29002 tablet_bootstrap.cc:492] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Bootstrap starting.
I20260807 04:59:42.054092 28185 catalog_manager.cc:4841] TS 122f0db3363e4d88bba663463cefde9a (127.25.214.194:34285): tablet 5a8bd0cfe3604bd2b54737d82faf1bef (table test-table [id=d425c7e7b856407eac30524bf31a3835]) successfully deleted
I20260807 04:59:42.054168 29040 log.cc:1196] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/5a8bd0cfe3604bd2b54737d82faf1bef
I20260807 04:59:42.054658 29002 tablet_bootstrap.cc:654] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:42.054950 28643 tablet_service.cc:1467] Processing CreateTablet for tablet 8923dd9cd61a4a8393d526d1e19897f4 (DEFAULT_TABLE table=test-table [id=61b97633b1334cb9b4acf3a3b101f069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:42.055231 28643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8923dd9cd61a4a8393d526d1e19897f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:42.055728 29039 ts_tablet_manager.cc:1905] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:42.056067 29002 tablet_bootstrap.cc:492] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: No bootstrap required, opened a new log
I20260807 04:59:42.056185 29002 ts_tablet_manager.cc:1397] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 04:59:42.056653 29002 raft_consensus.cc:348] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.056798 29002 raft_consensus.cc:374] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:42.056835 29002 raft_consensus.cc:729] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81a9cb90c624c909b18b333b7a3eac8, State: Initialized, Role: FOLLOWER
I20260807 04:59:42.056958 29002 consensus_queue.cc:260] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.057226 29002 ts_tablet_manager.cc:1428] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 04:59:42.057631 29003 tablet_bootstrap.cc:492] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Bootstrap starting.
I20260807 04:59:42.058595 29003 tablet_bootstrap.cc:654] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:42.059055 29039 ts_tablet_manager.cc:1918] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:59:42.059198 29039 log.cc:1196] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/5a8bd0cfe3604bd2b54737d82faf1bef
I20260807 04:59:42.059554 29039 ts_tablet_manager.cc:1939] T 5a8bd0cfe3604bd2b54737d82faf1bef P e81a9cb90c624c909b18b333b7a3eac8: Deleting consensus metadata
I20260807 04:59:42.060230 29003 tablet_bootstrap.cc:492] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: No bootstrap required, opened a new log
I20260807 04:59:42.060313 29003 ts_tablet_manager.cc:1397] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:59:42.054507 29007 tablet_bootstrap.cc:654] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:42.060729 29003 raft_consensus.cc:348] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.060837 29003 raft_consensus.cc:374] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:42.060822 28190 catalog_manager.cc:4841] TS e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977): tablet 5a8bd0cfe3604bd2b54737d82faf1bef (table test-table [id=d425c7e7b856407eac30524bf31a3835]) successfully deleted
I20260807 04:59:42.060871 29003 raft_consensus.cc:729] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 122f0db3363e4d88bba663463cefde9a, State: Initialized, Role: FOLLOWER
I20260807 04:59:42.060994 29003 consensus_queue.cc:260] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.061232 29003 ts_tablet_manager.cc:1428] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:42.061558 29040 ts_tablet_manager.cc:1939] T 5a8bd0cfe3604bd2b54737d82faf1bef P 62691eb6b86041ef8be80d80faceb1e5: Deleting consensus metadata
I20260807 04:59:42.062031 29007 tablet_bootstrap.cc:492] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: No bootstrap required, opened a new log
I20260807 04:59:42.062135 29007 ts_tablet_manager.cc:1397] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 04:59:42.062575 29007 raft_consensus.cc:348] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.062690 29007 raft_consensus.cc:374] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:42.062721 29007 raft_consensus.cc:729] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62691eb6b86041ef8be80d80faceb1e5, State: Initialized, Role: FOLLOWER
I20260807 04:59:42.062834 29007 consensus_queue.cc:260] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.063082 29007 ts_tablet_manager.cc:1428] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:42.064391 28177 catalog_manager.cc:4841] TS 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857): tablet 5a8bd0cfe3604bd2b54737d82faf1bef (table test-table [id=d425c7e7b856407eac30524bf31a3835]) successfully deleted
I20260807 04:59:42.152842 29014 raft_consensus.cc:482] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:42.153016 29014 raft_consensus.cc:504] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.154114 29014 leader_election.cc:288] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977), 122f0db3363e4d88bba663463cefde9a (127.25.214.194:34285)
I20260807 04:59:42.158584 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.154817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:42427 (local address 127.25.214.194:34285)
0807 04:59:42.154964 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.154969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.154986 (+ 17us) server_negotiation.cc:407] Connection header received
0807 04:59:42.155044 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.155047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.155121 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.155213 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:42.155507 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.156293 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.157601 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.157982 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.158098 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.158158 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.158352 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.158432 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 04:59:42.158671 29047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.154348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:34977 (local address 127.25.214.195:46511)
0807 04:59:42.154650 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:42.154665 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:42.154819 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:42.155098 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:42.155101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:42.155119 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:42.155240 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.155247 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.156157 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.156160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.157380 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.157391 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.158277 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.158281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.158371 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.158419 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 04:59:42.158485 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 04:59:42.158552 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":73,"threads_started":1}
I20260807 04:59:42.158737 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.154474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:46511 (local address 127.25.214.193:34977)
0807 04:59:42.154629 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.154634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.154732 (+ 98us) server_negotiation.cc:407] Connection header received
0807 04:59:42.154953 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.154955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.155000 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.155061 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:42.155527 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.156024 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.157527 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.158161 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.158292 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.158342 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.158525 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.158605 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:59:42.159116 29051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.154413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:34285 (local address 127.25.214.195:42427)
0807 04:59:42.154731 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:42.154743 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:42.154820 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:42.155236 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:42.155238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:42.155254 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:42.155337 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.155342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.156412 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.156415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.157485 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.157504 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.158103 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.158107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.158208 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.158230 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 04:59:42.158907 (+ 677us) client_negotiation.cc:240] Negotiation successful
0807 04:59:42.158973 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"spinlock_wait_cycles":15744,"thread_start_us":86,"threads_started":1}
I20260807 04:59:42.159238 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8923dd9cd61a4a8393d526d1e19897f4" candidate_uuid: "62691eb6b86041ef8be80d80faceb1e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81a9cb90c624c909b18b333b7a3eac8" is_pre_election: true
I20260807 04:59:42.159394 28454 raft_consensus.cc:2454] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62691eb6b86041ef8be80d80faceb1e5 in term 0.
I20260807 04:59:42.159711 28677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8923dd9cd61a4a8393d526d1e19897f4" candidate_uuid: "62691eb6b86041ef8be80d80faceb1e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "122f0db3363e4d88bba663463cefde9a" is_pre_election: true
I20260807 04:59:42.159899 28794 leader_election.cc:302] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62691eb6b86041ef8be80d80faceb1e5, e81a9cb90c624c909b18b333b7a3eac8; no voters:
I20260807 04:59:42.159998 28677 raft_consensus.cc:2454] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62691eb6b86041ef8be80d80faceb1e5 in term 0.
I20260807 04:59:42.160210 29014 raft_consensus.cc:2781] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:42.160277 29014 raft_consensus.cc:482] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:42.160323 29014 raft_consensus.cc:3037] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:42.161586 29014 raft_consensus.cc:504] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.161960 29014 leader_election.cc:288] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [CANDIDATE]: Term 1 election: Requested vote from peers e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977), 122f0db3363e4d88bba663463cefde9a (127.25.214.194:34285)
I20260807 04:59:42.162323 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8923dd9cd61a4a8393d526d1e19897f4" candidate_uuid: "62691eb6b86041ef8be80d80faceb1e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81a9cb90c624c909b18b333b7a3eac8"
I20260807 04:59:42.162462 28454 raft_consensus.cc:3037] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:42.163684 28454 raft_consensus.cc:2454] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62691eb6b86041ef8be80d80faceb1e5 in term 1.
I20260807 04:59:42.163978 28794 leader_election.cc:302] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62691eb6b86041ef8be80d80faceb1e5, e81a9cb90c624c909b18b333b7a3eac8; no voters:
I20260807 04:59:42.163969 28677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8923dd9cd61a4a8393d526d1e19897f4" candidate_uuid: "62691eb6b86041ef8be80d80faceb1e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "122f0db3363e4d88bba663463cefde9a"
I20260807 04:59:42.164130 28677 raft_consensus.cc:3037] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:42.164194 29014 raft_consensus.cc:2781] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:42.164351 29014 raft_consensus.cc:686] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 1 LEADER]: Becoming Leader. State: Replica: 62691eb6b86041ef8be80d80faceb1e5, State: Running, Role: LEADER
I20260807 04:59:42.164598 29014 consensus_queue.cc:237] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.165380 28677 raft_consensus.cc:2454] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62691eb6b86041ef8be80d80faceb1e5 in term 1.
I20260807 04:59:42.167128 28207 catalog_manager.cc:5495] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "62691eb6b86041ef8be80d80faceb1e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } health_report { overall_health: HEALTHY } } }
Aug 07 04:59:42 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078780, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:42.213968 29060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.205926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40867 (local address 127.0.0.1:57062)
0807 04:59:42.206284 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:42.206300 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:42.206422 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:42.206660 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:42.206662 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:42.207078 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:42.207174 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.207181 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.207923 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.207926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.208503 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.208512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.209083 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.209086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.209147 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.209658 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:42.209669 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:42.211086 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:42.212608 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:42.212617 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:42.212622 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:42.212854 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:42.213082 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:42.213084 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:42.213085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:42.213160 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:42.213479 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:42.213484 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:42.213598 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 04:59:42.213690 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 04:59:42.213820 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":121,"threads_started":1}
I20260807 04:59:42.214021 29062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.205970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.25.214.254:40867)
0807 04:59:42.206284 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.206294 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.206362 (+ 68us) server_negotiation.cc:407] Connection header received
0807 04:59:42.206509 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.206512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.206553 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.206626 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:42.207292 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.207821 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.208611 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.208821 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.208907 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.211209 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:42.211212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:42.211214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:42.211234 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:42.212511 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:42.212938 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:42.212940 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:42.212941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:42.213021 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:42.213220 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:42.213222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:42.213223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:42.213379 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:42.213447 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.213735 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.213887 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":260,"thread_start_us":100,"threads_started":1}
I20260807 04:59:42.217869 28207 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:57062:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 04:59:42.218542 28207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:42.222980 28423 tablet_service.cc:1467] Processing CreateTablet for tablet aa129eed45d345cab7e48af3c1a9367c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a7f34ab60ff24ff78d8f80440f441306]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:59:42.223059 28643 tablet_service.cc:1467] Processing CreateTablet for tablet aa129eed45d345cab7e48af3c1a9367c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a7f34ab60ff24ff78d8f80440f441306]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:59:42.223188 28861 tablet_service.cc:1467] Processing CreateTablet for tablet aa129eed45d345cab7e48af3c1a9367c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a7f34ab60ff24ff78d8f80440f441306]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:59:42.223462 28423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa129eed45d345cab7e48af3c1a9367c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:42.223464 28643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa129eed45d345cab7e48af3c1a9367c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:42.223508 28861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa129eed45d345cab7e48af3c1a9367c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:42.226131 29003 tablet_bootstrap.cc:492] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: Bootstrap starting.
I20260807 04:59:42.226346 29002 tablet_bootstrap.cc:492] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: Bootstrap starting.
I20260807 04:59:42.226958 29003 tablet_bootstrap.cc:654] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:42.227217 29002 tablet_bootstrap.cc:654] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:42.227901 29007 tablet_bootstrap.cc:492] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: Bootstrap starting.
I20260807 04:59:42.228138 29003 tablet_bootstrap.cc:492] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: No bootstrap required, opened a new log
I20260807 04:59:42.228245 29003 ts_tablet_manager.cc:1397] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:42.228477 29002 tablet_bootstrap.cc:492] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: No bootstrap required, opened a new log
I20260807 04:59:42.228598 29002 ts_tablet_manager.cc:1397] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 04:59:42.228647 29003 raft_consensus.cc:348] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.228770 29003 raft_consensus.cc:374] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:42.228811 29003 raft_consensus.cc:729] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 122f0db3363e4d88bba663463cefde9a, State: Initialized, Role: FOLLOWER
I20260807 04:59:42.228888 29007 tablet_bootstrap.cc:654] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:42.228962 29003 consensus_queue.cc:260] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.229046 29002 raft_consensus.cc:348] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.229156 29002 raft_consensus.cc:374] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:42.229192 29002 raft_consensus.cc:729] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81a9cb90c624c909b18b333b7a3eac8, State: Initialized, Role: FOLLOWER
I20260807 04:59:42.229249 29003 ts_tablet_manager.cc:1428] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:42.229346 29021 raft_consensus.cc:482] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:42.229315 29002 consensus_queue.cc:260] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.229424 29021 raft_consensus.cc:504] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.229573 29002 ts_tablet_manager.cc:1428] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 04:59:42.229591 29009 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.229718 29009 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.229789 29021 leader_election.cc:288] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977), 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857)
I20260807 04:59:42.230083 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa129eed45d345cab7e48af3c1a9367c" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81a9cb90c624c909b18b333b7a3eac8" is_pre_election: true
I20260807 04:59:42.230192 28454 raft_consensus.cc:2454] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 0.
I20260807 04:59:42.230187 28892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa129eed45d345cab7e48af3c1a9367c" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62691eb6b86041ef8be80d80faceb1e5" is_pre_election: true
I20260807 04:59:42.230378 29032 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.230520 29032 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.230782 28575 leader_election.cc:302] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 122f0db3363e4d88bba663463cefde9a, e81a9cb90c624c909b18b333b7a3eac8; no voters:
I20260807 04:59:42.230950 29032 raft_consensus.cc:2781] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:42.231020 29032 raft_consensus.cc:482] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:42.231072 29032 raft_consensus.cc:3037] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 0 FOLLOWER]: Advancing to term 1
W20260807 04:59:42.230950 28572 leader_election.cc:341] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857): Illegal state: must be running to vote when last-logged opid is not known
I20260807 04:59:42.232191 29032 raft_consensus.cc:504] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.232282 29007 tablet_bootstrap.cc:492] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: No bootstrap required, opened a new log
I20260807 04:59:42.232355 29007 ts_tablet_manager.cc:1397] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 04:59:42.232532 29032 leader_election.cc:288] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 election: Requested vote from peers e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977), 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857)
I20260807 04:59:42.232821 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa129eed45d345cab7e48af3c1a9367c" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81a9cb90c624c909b18b333b7a3eac8"
I20260807 04:59:42.232836 29007 raft_consensus.cc:348] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.232890 28892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa129eed45d345cab7e48af3c1a9367c" candidate_uuid: "122f0db3363e4d88bba663463cefde9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62691eb6b86041ef8be80d80faceb1e5"
I20260807 04:59:42.232937 29007 raft_consensus.cc:374] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:42.232930 28454 raft_consensus.cc:3037] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:42.232968 29007 raft_consensus.cc:729] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62691eb6b86041ef8be80d80faceb1e5, State: Initialized, Role: FOLLOWER
I20260807 04:59:42.233089 29007 consensus_queue.cc:260] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.233341 29007 ts_tablet_manager.cc:1428] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:42.233453 29014 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.233590 29014 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.233753 28892 raft_consensus.cc:3037] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:42.233903 28454 raft_consensus.cc:2454] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 1.
I20260807 04:59:42.234217 28575 leader_election.cc:302] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 122f0db3363e4d88bba663463cefde9a, e81a9cb90c624c909b18b333b7a3eac8; no voters:
I20260807 04:59:42.234402 29032 raft_consensus.cc:2781] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:42.234512 29032 raft_consensus.cc:686] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [term 1 LEADER]: Becoming Leader. State: Replica: 122f0db3363e4d88bba663463cefde9a, State: Running, Role: LEADER
I20260807 04:59:42.234668 28892 raft_consensus.cc:2454] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 122f0db3363e4d88bba663463cefde9a in term 1.
I20260807 04:59:42.234639 29032 consensus_queue.cc:237] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } }
I20260807 04:59:42.235275 29021 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: TxnStatusTablet state changed. Reason: New leader 122f0db3363e4d88bba663463cefde9a. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.235383 29021 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:59:42.235725 29068 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 04:59:42.235920 29068 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 04:59:42.236536 28208 catalog_manager.cc:5495] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 122f0db3363e4d88bba663463cefde9a (127.25.214.194). New cstate: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } health_report { overall_health: UNKNOWN } } }
I20260807 04:59:42.250362 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.247302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39526 (local address 127.25.214.194:34285)
0807 04:59:42.247413 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.247418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.247441 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:59:42.247609 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.247613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.247659 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.247721 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:42.247954 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.248519 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.249350 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.249571 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.249657 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.249923 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.249999 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.250057 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.250165 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.250220 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 04:59:42.250362 29060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.247221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:34285 (local address 127.0.0.1:39526)
0807 04:59:42.247366 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:42.247382 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:42.247491 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:42.247750 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:42.247753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:42.247760 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:42.247858 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.247863 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.248632 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.248636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.249240 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.249248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.249669 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.249672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.249751 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.249797 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.250073 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.250088 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 04:59:42.250146 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 04:59:42.250231 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 04:59:42.253083 28892 raft_consensus.cc:1261] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Refusing update from remote peer 122f0db3363e4d88bba663463cefde9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:42.253180 28454 raft_consensus.cc:1261] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Refusing update from remote peer 122f0db3363e4d88bba663463cefde9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:42.253543 29021 consensus_queue.cc:1035] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:42.253749 29032 consensus_queue.cc:1035] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:42.255117 29009 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: TxnStatusTablet state changed. Reason: New leader 122f0db3363e4d88bba663463cefde9a. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.255223 29009 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.255254 29014 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: TxnStatusTablet state changed. Reason: New leader 122f0db3363e4d88bba663463cefde9a. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.255374 29014 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.256767 29032 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.256871 29032 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:59:42.257226 29025 mvcc.cc:205] Tried to move back new op lower bound from 7315778692104032256 to 7315778692034310144. Current Snapshot: MvccSnapshot[applied={T|T < 7315778692104032256}]
I20260807 04:59:42.257601 29009 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.257699 29009 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P e81a9cb90c624c909b18b333b7a3eac8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.258375 29026 mvcc.cc:205] Tried to move back new op lower bound from 7315778692104032256 to 7315778692034310144. Current Snapshot: MvccSnapshot[applied={T|T < 7315778692104032256 or (T in {7315778692104032256})}]
I20260807 04:59:42.258632 29032 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.258729 29032 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 122f0db3363e4d88bba663463cefde9a: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:59:42.259300 29014 tablet_replica.cc:439] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "122f0db3363e4d88bba663463cefde9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 } } peers { permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 } } peers { permanent_uuid: "62691eb6b86041ef8be80d80faceb1e5" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39857 } } }
I20260807 04:59:42.259403 29014 tablet_replica.cc:442] T aa129eed45d345cab7e48af3c1a9367c P 62691eb6b86041ef8be80d80faceb1e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:42.266937 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.263488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.25.214.195:39857)
0807 04:59:42.263605 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.263610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.263640 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:59:42.263705 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.263707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.263754 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.263827 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:42.264051 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.264585 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.265678 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.265874 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.265940 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.266181 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.266612 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.266694 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.266776 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.266820 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 04:59:42.277009 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.273866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:41769 (local address 127.25.214.194:34285)
0807 04:59:42.273987 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.273992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.274163 (+ 171us) server_negotiation.cc:407] Connection header received
0807 04:59:42.274271 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.274274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.274322 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.274380 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:42.274626 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.275125 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.275961 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.276226 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.276310 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.276606 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.276676 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.276732 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.276819 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.276867 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 04:59:42.277395 29075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.273806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:34285 (local address 127.25.214.195:41769)
0807 04:59:42.274083 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:42.274095 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:42.274189 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:42.274396 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:42.274399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:42.274406 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:42.274527 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.274532 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.275223 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.275227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.275839 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.275848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.276354 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.276358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.276443 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.276484 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.276747 (+ 263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.276754 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 04:59:42.276810 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 04:59:42.276883 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":109,"threads_started":1}
I20260807 04:59:42.284193 28677 raft_consensus.cc:1261] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Refusing update from remote peer 62691eb6b86041ef8be80d80faceb1e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:42.284462 28454 raft_consensus.cc:1261] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Refusing update from remote peer 62691eb6b86041ef8be80d80faceb1e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:42.284737 29014 consensus_queue.cc:1035] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "122f0db3363e4d88bba663463cefde9a" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 34285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:42.285008 29052 consensus_queue.cc:1035] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e81a9cb90c624c909b18b333b7a3eac8" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:42.309688 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.305757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39857 (local address 127.25.214.194:43789)
0807 04:59:42.306078 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:42.306092 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:42.306184 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:42.306415 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:42.306418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:42.306425 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:42.306538 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.306543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.307239 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.307243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.308426 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:42.308447 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.308973 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.308977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:42.309061 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.309110 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.309386 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.309392 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:59:42.309464 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 04:59:42.309545 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":106,"threads_started":1}
I20260807 04:59:42.309669 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.305906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:43789 (local address 127.25.214.195:39857)
0807 04:59:42.306017 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.306021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.306155 (+ 134us) server_negotiation.cc:407] Connection header received
0807 04:59:42.306287 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.306290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.306337 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.306397 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:42.306630 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.307139 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.308584 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.308865 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.308968 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.309233 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:42.309312 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:42.309369 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.309476 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.309525 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 04:59:42.340009 28209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:42.340230 28209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:42.342785 28209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0585c8ad38b24c6eb5f43a55e53439df: Sending DeleteTablet for 3 replicas of tablet 8923dd9cd61a4a8393d526d1e19897f4
I20260807 04:59:42.343425 28423 tablet_service.cc:1514] Processing DeleteTablet for tablet 8923dd9cd61a4a8393d526d1e19897f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42602
I20260807 04:59:42.343511 28861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8923dd9cd61a4a8393d526d1e19897f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:45966
I20260807 04:59:42.343647 29039 tablet_replica.cc:330] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: stopping tablet replica
I20260807 04:59:42.343690 29040 tablet_replica.cc:330] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: stopping tablet replica
I20260807 04:59:42.343776 29039 raft_consensus.cc:2229] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:42.343817 29040 raft_consensus.cc:2229] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:59:42.343922 29039 raft_consensus.cc:2258] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:42.344170 29040 raft_consensus.cc:2258] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:42.344898 29039 ts_tablet_manager.cc:1905] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:42.344947 29040 ts_tablet_manager.cc:1905] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:42.347805 29040 ts_tablet_manager.cc:1918] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:42.347807 29039 ts_tablet_manager.cc:1918] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:42.347879 29040 log.cc:1196] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/8923dd9cd61a4a8393d526d1e19897f4
I20260807 04:59:42.347883 29039 log.cc:1196] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/8923dd9cd61a4a8393d526d1e19897f4
I20260807 04:59:42.348177 29040 ts_tablet_manager.cc:1939] T 8923dd9cd61a4a8393d526d1e19897f4 P 62691eb6b86041ef8be80d80faceb1e5: Deleting consensus metadata
I20260807 04:59:42.349203 28177 catalog_manager.cc:4841] TS 62691eb6b86041ef8be80d80faceb1e5 (127.25.214.195:39857): tablet 8923dd9cd61a4a8393d526d1e19897f4 (table test-table [id=61b97633b1334cb9b4acf3a3b101f069]) successfully deleted
I20260807 04:59:42.350847 28643 tablet_service.cc:1514] Processing DeleteTablet for tablet 8923dd9cd61a4a8393d526d1e19897f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:39496
I20260807 04:59:42.351035 29038 tablet_replica.cc:330] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: stopping tablet replica
I20260807 04:59:42.351145 29038 raft_consensus.cc:2229] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:42.351266 29038 raft_consensus.cc:2258] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:42.352209 29038 ts_tablet_manager.cc:1905] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:42.355309 29038 ts_tablet_manager.cc:1918] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:42.355398 29038 log.cc:1196] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/8923dd9cd61a4a8393d526d1e19897f4
I20260807 04:59:42.355634 29038 ts_tablet_manager.cc:1939] T 8923dd9cd61a4a8393d526d1e19897f4 P 122f0db3363e4d88bba663463cefde9a: Deleting consensus metadata
I20260807 04:59:42.363159 28185 catalog_manager.cc:4841] TS 122f0db3363e4d88bba663463cefde9a (127.25.214.194:34285): tablet 8923dd9cd61a4a8393d526d1e19897f4 (table test-table [id=61b97633b1334cb9b4acf3a3b101f069]) successfully deleted
I20260807 04:59:42.363631 29039 ts_tablet_manager.cc:1939] T 8923dd9cd61a4a8393d526d1e19897f4 P e81a9cb90c624c909b18b333b7a3eac8: Deleting consensus metadata
I20260807 04:59:42.364537 28190 catalog_manager.cc:4841] TS e81a9cb90c624c909b18b333b7a3eac8 (127.25.214.193:34977): tablet 8923dd9cd61a4a8393d526d1e19897f4 (table test-table [id=61b97633b1334cb9b4acf3a3b101f069]) successfully deleted
Aug 07 04:59:42 dist-test-slave-lgr5 krb5kdc[28129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078781, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:42.372572 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.350592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42608 (local address 127.25.214.193:34977)
0807 04:59:42.350720 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.350725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.351114 (+ 389us) server_negotiation.cc:407] Connection header received
0807 04:59:42.351326 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.351330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.351401 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.351456 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:42.352551 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.353304 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.354656 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.354986 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.355096 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.368291 (+ 13195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:42.368309 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:42.368326 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:42.368372 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:42.370412 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:42.370938 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:42.370945 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:42.370947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:42.371035 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:42.371333 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:42.371336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:42.371338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:42.371657 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:42.371827 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.372254 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.372404 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 04:59:42.373598 28521 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42608
I20260807 04:59:42.385548 29062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:42.376029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57070 (local address 127.25.214.254:40867)
0807 04:59:42.376213 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:42.376218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:42.376611 (+ 393us) server_negotiation.cc:407] Connection header received
0807 04:59:42.376797 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:42.376800 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:42.376849 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:42.376901 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:42.377833 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.378691 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.379867 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:42.380281 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:42.380356 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:42.382046 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:42.382050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:42.382053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:42.382080 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:42.383685 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:42.384180 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:42.384184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:42.384186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:42.384274 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:42.384576 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:42.384580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:42.384582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:42.384792 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:42.384891 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:42.385240 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 04:59:42.385380 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 04:59:42.386443 28209 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57070
I20260807 04:59:42.387996 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28318
I20260807 04:59:42.408601 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28541
I20260807 04:59:42.422286 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28763
I20260807 04:59:42.438287 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28151
2026-08-07T04:59:42Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3028 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:42 dist-test-slave-lgr5 krb5kdc[29103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:42 dist-test-slave-lgr5 krb5kdc[29103](info): set up 2 sockets
Aug 07 04:59:42 dist-test-slave-lgr5 krb5kdc[29103](info): commencing operation
krb5kdc: starting...
W20260807 04:59:43.583420 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:43 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:43.703011 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:44431
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:44431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:43.818574 29122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:43.818864 29122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:43.818929 29122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:43.823007 29122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:43.823071 29122 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 04:59:43.823097 29122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:43.823127 29122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:43.823161 29122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:43.823187 29122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:43.828807 29122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:44431
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:44431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:43.830175 29122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:43.831264 29122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:43.839726 29142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:43.839761 29137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:43.839761 29148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:43.839838 29122 server_base.cc:1034] running on GCE node
I20260807 04:59:43.840571 29122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:43.841655 29122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:43.842810 29122 hybrid_clock.cc:648] HybridClock initialized: now 1786078783842797 us; error 28 us; skew 500 ppm
Aug 07 04:59:43 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078783, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:43.845556 29122 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:43.846513 29122 webserver.cc:460] Webserver started at http://127.25.214.254:32819/ using document root <none> and password file <none>
I20260807 04:59:43.847092 29122 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:43.847162 29122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:43.847365 29122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:43.849542 29122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "b1a16c5b671e4ffdaf256561970f40f0"
format_stamp: "Formatted at 2026-08-07 04:59:43 on dist-test-slave-lgr5"
server_key: "7ec80cf0e730ff24c0990c6f327070c7"
server_key_iv: "4db46f73b048a72db1d1b449ea9323f3"
server_key_version: "encryptionkey@0"
I20260807 04:59:43.850100 29122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "b1a16c5b671e4ffdaf256561970f40f0"
format_stamp: "Formatted at 2026-08-07 04:59:43 on dist-test-slave-lgr5"
server_key: "7ec80cf0e730ff24c0990c6f327070c7"
server_key_iv: "4db46f73b048a72db1d1b449ea9323f3"
server_key_version: "encryptionkey@0"
I20260807 04:59:43.853696 29122 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 04:59:43.856052 29158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:43.857250 29122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:43.857364 29122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "b1a16c5b671e4ffdaf256561970f40f0"
format_stamp: "Formatted at 2026-08-07 04:59:43 on dist-test-slave-lgr5"
server_key: "7ec80cf0e730ff24c0990c6f327070c7"
server_key_iv: "4db46f73b048a72db1d1b449ea9323f3"
server_key_version: "encryptionkey@0"
I20260807 04:59:43.857457 29122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:43.904685 29122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:43.907625 29122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:43.907809 29122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:43.915427 29122 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:44431
I20260807 04:59:43.915467 29269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:44431 every 8 connection(s)
I20260807 04:59:43.916388 29122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:43.919168 29270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:43.919828 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29122
I20260807 04:59:43.919931 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:43.920217 26459 external_mini_cluster.cc:1428] Setting key 54e226dacd1ad50eeab32645185a5aed
I20260807 04:59:43.925165 29270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Bootstrap starting.
I20260807 04:59:43.927601 29270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:43.928505 29270 log.cc:824] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Log is configured to *not* fsync() on all Append() calls
Aug 07 04:59:43 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:43.930612 29270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: No bootstrap required, opened a new log
I20260807 04:59:43.934082 29270 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a16c5b671e4ffdaf256561970f40f0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44431 } }
I20260807 04:59:43.934331 29270 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:43.934387 29270 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a16c5b671e4ffdaf256561970f40f0, State: Initialized, Role: FOLLOWER
I20260807 04:59:43.934649 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:43.921583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42602 (local address 127.25.214.254:44431)
0807 04:59:43.922024 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:43.922039 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:43.922075 (+ 36us) server_negotiation.cc:407] Connection header received
0807 04:59:43.922710 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:43.922727 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:43.923040 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:43.923343 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:43.924161 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:43.925131 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:43.925988 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:43.926475 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:43.926637 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:43.929319 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:43.929327 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:43.929357 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:43.929387 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:43.931725 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:43.932252 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:43.932257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:43.932262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:43.932405 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:43.932674 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:43.932676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:43.932677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:43.933068 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:43.933227 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:43.933489 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 04:59:43.933778 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":143,"threads_started":1}
I20260807 04:59:43.934835 29270 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a16c5b671e4ffdaf256561970f40f0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44431 } }
I20260807 04:59:43.934967 29270 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:43.935029 29270 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:43.935143 29270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:43.936036 29270 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a16c5b671e4ffdaf256561970f40f0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44431 } }
I20260807 04:59:43.936373 29270 leader_election.cc:302] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1a16c5b671e4ffdaf256561970f40f0; no voters:
I20260807 04:59:43.936684 29270 leader_election.cc:288] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:43.936758 29277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:43.936960 29277 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [term 1 LEADER]: Becoming Leader. State: Replica: b1a16c5b671e4ffdaf256561970f40f0, State: Running, Role: LEADER
I20260807 04:59:43.937250 29277 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a16c5b671e4ffdaf256561970f40f0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44431 } }
I20260807 04:59:43.937808 29270 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:43.938858 29279 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1a16c5b671e4ffdaf256561970f40f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a16c5b671e4ffdaf256561970f40f0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44431 } } }
I20260807 04:59:43.939136 29279 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:43.939042 29277 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1a16c5b671e4ffdaf256561970f40f0. Latest consensus state: current_term: 1 leader_uuid: "b1a16c5b671e4ffdaf256561970f40f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a16c5b671e4ffdaf256561970f40f0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44431 } } }
I20260807 04:59:43.939356 29277 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:43.939936 29291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:43.942968 29291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:43.948148 29291 catalog_manager.cc:1347] Generated new cluster ID: fd05c5a6026d4c80bcc4942e16e2f03a
I20260807 04:59:43.948213 29291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:43.969725 29291 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:43.970678 29291 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:43.982375 29291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Generated new TSK 0
I20260807 04:59:43.983217 29291 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:44.016791 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:44431
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:44.130307 29312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:44.130599 29312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:44.130646 29312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:44.134748 29312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:44.134817 29312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:44.134857 29312 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 04:59:44.134869 29312 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:59:44.134910 29312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:44.140514 29312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:44431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:44.141629 29312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:44.142697 29312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:44.152558 29324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:44.152709 29312 server_base.cc:1034] running on GCE node
W20260807 04:59:44.152561 29322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:44.152925 29320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:44.153383 29312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:44.154072 29312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:44.155230 29312 hybrid_clock.cc:648] HybridClock initialized: now 1786078784155210 us; error 31 us; skew 500 ppm
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:44.158010 29312 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:44.158931 29312 webserver.cc:460] Webserver started at http://127.25.214.193:46767/ using document root <none> and password file <none>
I20260807 04:59:44.159631 29312 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:44.159703 29312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:44.159916 29312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:44.162083 29312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "ba9049cf94454db3be9f7682900c5e9d"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "0264abf87a4d4c3817efe280198942a6"
server_key_iv: "99f26a61c4c95dec2bfde4ca41d32165"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.162648 29312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "ba9049cf94454db3be9f7682900c5e9d"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "0264abf87a4d4c3817efe280198942a6"
server_key_iv: "99f26a61c4c95dec2bfde4ca41d32165"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.166487 29312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 04:59:44.169054 29333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:44.170285 29312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:44.170392 29312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "ba9049cf94454db3be9f7682900c5e9d"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "0264abf87a4d4c3817efe280198942a6"
server_key_iv: "99f26a61c4c95dec2bfde4ca41d32165"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.170499 29312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:44.191601 29312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:44.194660 29312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:44.194831 29312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:44.196417 29312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:44.196482 29312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:44.196527 29312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:44.196554 29312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:44.207430 29312 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:38199
I20260807 04:59:44.208247 29508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:38199 every 8 connection(s)
I20260807 04:59:44.208469 29312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:44.211319 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.197318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50839 (local address 127.25.214.254:44431)
0807 04:59:44.197441 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.197445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.198605 (+ 1160us) server_negotiation.cc:407] Connection header received
0807 04:59:44.199699 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.199702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.199771 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.199854 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.201609 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.202400 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.204293 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.204603 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.204696 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.207811 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.207815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.207818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.207848 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.209481 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.209997 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.210000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.210001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.210086 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.210375 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.210377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.210378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.210564 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.210638 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.211081 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.211190 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 04:59:44.212212 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.197888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.25.214.193:50839)
0807 04:59:44.198431 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.198479 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.199428 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.200132 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.200143 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.200668 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.201420 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.201446 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.202561 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.202565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.204137 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.204152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.204792 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.204797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.205034 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.205781 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.205804 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.207635 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.209591 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.209595 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.209607 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.209901 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.210163 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.210165 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.210167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.210307 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.210639 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.210644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.210887 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.211050 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.211312 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":148,"threads_started":1}
I20260807 04:59:44.213280 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29312
I20260807 04:59:44.213389 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:44.213620 29509 heartbeater.cc:347] Connected to a master server at 127.25.214.254:44431
I20260807 04:59:44.213696 26459 external_mini_cluster.cc:1428] Setting key 284e81d2506766123dc5c8aa33a3688c
I20260807 04:59:44.213757 29509 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:44.214275 29509 heartbeater.cc:511] Master 127.25.214.254:44431 requested a full tablet report, sending...
I20260807 04:59:44.215878 29182 ts_manager.cc:194] Registered new tserver with Master: ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199)
I20260807 04:59:44.217064 29182 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:50839
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 04:59:44.224612 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.215937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:59423 (local address 127.25.214.254:44431)
0807 04:59:44.217619 (+ 1682us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.217624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.217638 (+ 14us) server_negotiation.cc:407] Connection header received
0807 04:59:44.217674 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.217677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.217716 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.217803 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.218333 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.219083 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.220269 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.220487 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.220566 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.221749 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.221752 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.221754 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.221776 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.223031 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.223480 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.223483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.223484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.223549 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.223807 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.223809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.223810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.223980 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.224071 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.224355 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.224473 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1620}
I20260807 04:59:44.224625 29515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.215867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.25.214.193:59423)
0807 04:59:44.216169 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.216183 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.216274 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.217840 (+ 1566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.217844 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.218075 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.218203 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.218211 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.219230 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.219234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.220154 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.220168 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.220600 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.220603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.220705 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.221186 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.221201 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.221619 (+ 418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.223144 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.223148 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.223149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.223389 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.223629 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.223632 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.223633 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.223729 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.224109 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.224112 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.224203 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.224294 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.224439 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":96,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:44.241115 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:44431
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:44.356205 29519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:44.356465 29519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:44.356519 29519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:44.360704 29519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:44.360775 29519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:44.360816 29519 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 04:59:44.360831 29519 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:59:44.360872 29519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:44.366425 29519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:44431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:44.367532 29519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:44.368629 29519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:44.378607 29528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:44.378715 29519 server_base.cc:1034] running on GCE node
W20260807 04:59:44.378609 29531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:44.378609 29529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:44.379343 29519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:44.380024 29519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:44.381228 29519 hybrid_clock.cc:648] HybridClock initialized: now 1786078784381202 us; error 36 us; skew 500 ppm
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:44.386839 29519 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:44.387739 29519 webserver.cc:460] Webserver started at http://127.25.214.194:34783/ using document root <none> and password file <none>
I20260807 04:59:44.388326 29519 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:44.388389 29519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:44.388568 29519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:44.390581 29519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "d7adc892caf34167a6e4e83b13ada879"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "069fcaa591a155783b102928b5fc3cad"
server_key_iv: "6e26317999a82337d856914ca5ae060d"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.391103 29519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "d7adc892caf34167a6e4e83b13ada879"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "069fcaa591a155783b102928b5fc3cad"
server_key_iv: "6e26317999a82337d856914ca5ae060d"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.394696 29519 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 04:59:44.397002 29540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:44.398157 29519 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:44.398254 29519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "d7adc892caf34167a6e4e83b13ada879"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "069fcaa591a155783b102928b5fc3cad"
server_key_iv: "6e26317999a82337d856914ca5ae060d"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.398335 29519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:44.408957 29519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:44.411573 29519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:44.411718 29519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:44.413154 29519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:44.413204 29519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:44.413245 29519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:44.413273 29519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:44.423801 29519 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:40365
I20260807 04:59:44.423854 29735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:40365 every 8 connection(s)
I20260807 04:59:44.424901 29519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:44.426539 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.413935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:51761 (local address 127.25.214.254:44431)
0807 04:59:44.414069 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.414074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.415165 (+ 1091us) server_negotiation.cc:407] Connection header received
0807 04:59:44.416165 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.416170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.416227 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.416284 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.417709 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.418517 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.419678 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.420012 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.420146 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.422839 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.422843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.422846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.422875 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.424428 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.424899 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.424902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.424904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.424999 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.425312 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.425316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.425318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.425576 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.425678 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.426231 (+ 553us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.426368 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 04:59:44.427322 29556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.414529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.25.214.194:51761)
0807 04:59:44.415007 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.415051 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.415902 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.416699 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.416706 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.417026 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.417553 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.417573 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.418644 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.418647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.419571 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.419582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.420223 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.420227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.420418 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.420981 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.421000 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.422676 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.424544 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.424549 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.424559 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.424797 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.425084 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.425086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.425087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.425219 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.425675 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.425681 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.425984 (+ 303us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.426169 (+ 185us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.426493 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":122,"threads_started":1}
I20260807 04:59:44.428488 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29519
I20260807 04:59:44.428484 29739 heartbeater.cc:347] Connected to a master server at 127.25.214.254:44431
I20260807 04:59:44.428617 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:44.428640 29739 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:44.428936 26459 external_mini_cluster.cc:1428] Setting key 2cb5e08fbb8b7f52113a03029fd61687
I20260807 04:59:44.429162 29739 heartbeater.cc:511] Master 127.25.214.254:44431 requested a full tablet report, sending...
I20260807 04:59:44.430204 29182 ts_manager.cc:194] Registered new tserver with Master: d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365)
I20260807 04:59:44.430871 29182 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:51761
I20260807 04:59:44.439046 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.431478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:60121 (local address 127.25.214.254:44431)
0807 04:59:44.431656 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.431660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.431882 (+ 222us) server_negotiation.cc:407] Connection header received
0807 04:59:44.432046 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.432049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.432115 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.432163 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.432764 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.433494 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.434490 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.434710 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.434786 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.435969 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.435972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.435974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.435994 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.437335 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.437832 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.437834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.437835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.437902 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.438162 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.438164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.438165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.438357 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.438430 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.438783 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.438875 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 04:59:44.439055 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.431359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.25.214.194:60121)
0807 04:59:44.431807 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.431821 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.431950 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.432301 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.432303 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.432515 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.432649 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.432657 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.433617 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.433620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.434373 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.434386 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.434820 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.434824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.434914 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.435387 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.435400 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.435841 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.437441 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.437445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.437448 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.437743 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.437982 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.437985 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.437987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.438083 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.438443 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.438446 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.438555 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.438686 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.438821 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:44.457401 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:44431
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:44.572453 29752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:44.572734 29752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:44.572803 29752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:44.577075 29752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:44.577149 29752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:44.577207 29752 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 04:59:44.577235 29752 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:59:44.577286 29752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:44.582974 29752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:44431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:44.584250 29752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:44.585305 29752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:44.594906 29763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:44.594869 29760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:44.595023 29752 server_base.cc:1034] running on GCE node
W20260807 04:59:44.594925 29759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:44.595578 29752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:44.596249 29752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:44.597445 29752 hybrid_clock.cc:648] HybridClock initialized: now 1786078784597428 us; error 28 us; skew 500 ppm
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:44.600227 29752 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:44.601142 29752 webserver.cc:460] Webserver started at http://127.25.214.195:43927/ using document root <none> and password file <none>
I20260807 04:59:44.601687 29752 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:44.601743 29752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:44.601958 29752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:44.603996 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "30de79fcea1ea39e1db519205e0e1d2d"
server_key_iv: "9c4d66617badaff7c6502c02a69531f8"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.604565 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "30de79fcea1ea39e1db519205e0e1d2d"
server_key_iv: "9c4d66617badaff7c6502c02a69531f8"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.608114 29752 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:44.610522 29775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:44.611766 29752 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:44.611871 29752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
format_stamp: "Formatted at 2026-08-07 04:59:44 on dist-test-slave-lgr5"
server_key: "30de79fcea1ea39e1db519205e0e1d2d"
server_key_iv: "9c4d66617badaff7c6502c02a69531f8"
server_key_version: "encryptionkey@0"
I20260807 04:59:44.611967 29752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:44.630776 29752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:44.633865 29752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:44.634080 29752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:44.635692 29752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:44.635748 29752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:44.635803 29752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:44.635829 29752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:44.646710 29752 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:45523
I20260807 04:59:44.646749 29948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:45523 every 8 connection(s)
I20260807 04:59:44.647768 29752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 04:59:44.649156 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.636492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:41511 (local address 127.25.214.254:44431)
0807 04:59:44.636612 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.636616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.637695 (+ 1079us) server_negotiation.cc:407] Connection header received
0807 04:59:44.638804 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.638808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.638881 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.638980 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.640299 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.641116 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.642324 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.642549 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.642648 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.645419 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.645423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.645426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.645453 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.646993 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.647454 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.647458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.647460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.647552 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.647947 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.647951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.647953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.648217 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.648317 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.648929 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.649035 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 04:59:44.649963 29790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.637048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.25.214.195:41511)
0807 04:59:44.637548 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.637591 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.638573 (+ 982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.639178 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.639187 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.639607 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.640150 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.640169 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.641241 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.641245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.642208 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.642218 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.642714 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.642719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.642903 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.643514 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.643539 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.645253 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.647097 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.647102 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.647114 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.647353 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.647674 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.647677 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.647678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.647843 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.648383 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.648389 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.648677 (+ 288us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.648860 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.649123 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":130,"threads_started":1}
I20260807 04:59:44.651151 29949 heartbeater.cc:347] Connected to a master server at 127.25.214.254:44431
I20260807 04:59:44.651291 29949 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:44.651829 29949 heartbeater.cc:511] Master 127.25.214.254:44431 requested a full tablet report, sending...
I20260807 04:59:44.652937 29183 ts_manager.cc:194] Registered new tserver with Master: aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:44.653580 29183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:41511
I20260807 04:59:44.654467 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29752
I20260807 04:59:44.654593 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:44.654940 26459 external_mini_cluster.cc:1428] Setting key 1af453d6c03489b4379f330a74243707
I20260807 04:59:44.657199 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:59:44.661034 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.653481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:33717 (local address 127.25.214.254:44431)
0807 04:59:44.653620 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.653624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.653887 (+ 263us) server_negotiation.cc:407] Connection header received
0807 04:59:44.653990 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.653993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.654034 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.654092 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.654660 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.655366 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.656472 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.656773 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.656878 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.658061 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.658064 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.658066 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.658089 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.659366 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.659759 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.659763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.659764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.659835 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.660146 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.660150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.660152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.660367 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.660441 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.660752 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.660868 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:59:44.661047 29958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.653392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.25.214.195:33717)
0807 04:59:44.653789 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.653805 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.653911 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.654131 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.654134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.654367 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.654513 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.654521 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.655535 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.655538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.656358 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.656370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.656877 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.656880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.656966 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.657482 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.657496 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.657928 (+ 432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.659469 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.659473 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.659475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.659672 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.659920 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.659923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.659925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.660012 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.660514 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.660517 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.660597 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.660679 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.660881 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":88,"threads_started":1}
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:44.685472 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.677104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42618 (local address 127.25.214.254:44431)
0807 04:59:44.677255 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.677259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.677272 (+ 13us) server_negotiation.cc:407] Connection header received
0807 04:59:44.677317 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.677319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.677359 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.677434 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.678186 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.678726 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.679580 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.679804 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.679905 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.682528 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.682531 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.682533 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.682568 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.683902 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.684448 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.684451 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.684452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.684535 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.684759 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.684761 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.684762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.684955 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.685055 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.685228 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.685340 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:59:44.688742 29183 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:59:44.691759 29183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:44.707224 29984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.700592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:38199 (local address 127.0.0.1:49646)
0807 04:59:44.701518 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.701581 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.701737 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.702438 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.702445 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.702470 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:44.702664 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.702672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.704255 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.704258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.705646 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.705659 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.706660 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.706664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.706774 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.706810 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.706935 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.707069 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":3,"spinlock_wait_cycles":13312,"thread_start_us":111,"threads_started":1}
I20260807 04:59:44.707240 29982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.700722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49646 (local address 127.25.214.193:38199)
0807 04:59:44.701558 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.701576 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.701897 (+ 321us) server_negotiation.cc:407] Connection header received
0807 04:59:44.701970 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.701974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.702140 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.702788 (+ 648us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:44.702959 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.704116 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.705771 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.706543 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.706682 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.706837 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.706974 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.707072 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":112,"threads_started":1}
I20260807 04:59:44.708766 29986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.701735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45523 (local address 127.0.0.1:36272)
0807 04:59:44.702872 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.702887 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.703002 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.703785 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.703788 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.703808 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:44.703966 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.703974 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.706159 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.706163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.707262 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.707272 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.708345 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.708349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.708454 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.708478 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.708560 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.708635 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1076,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260807 04:59:44.708835 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.702122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36272 (local address 127.25.214.195:45523)
0807 04:59:44.702751 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.702764 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.702998 (+ 234us) server_negotiation.cc:407] Connection header received
0807 04:59:44.703166 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.703174 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.703599 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.704192 (+ 593us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:44.704390 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.706039 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.707400 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.708209 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.708345 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.708476 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.708593 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.708680 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":115,"threads_started":1}
I20260807 04:59:44.709178 29981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.700767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40365 (local address 127.0.0.1:44902)
0807 04:59:44.701518 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.701581 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.701736 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.702486 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.702488 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.702502 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:44.703474 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.703484 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.705197 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.705201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.706854 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.706865 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.708555 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.708559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.708655 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.708678 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.708748 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.708811 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":955,"spinlock_wait_cycles":2816,"thread_start_us":103,"threads_started":1}
I20260807 04:59:44.709657 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.700982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44902 (local address 127.25.214.194:40365)
0807 04:59:44.701788 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.701799 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.701826 (+ 27us) server_negotiation.cc:407] Connection header received
0807 04:59:44.701908 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.701913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.702193 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.702322 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:44.703782 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.705059 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.707005 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.708209 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.708345 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.708468 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.709460 (+ 992us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.709538 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":117,"threads_started":1}
I20260807 04:59:44.710551 29406 tablet_service.cc:1467] Processing CreateTablet for tablet 2af600032a3d4cf8bce55fe66b7daf64 (DEFAULT_TABLE table=test-table [id=a5bac30f43db4555a841c4ad62213e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:44.711668 29406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af600032a3d4cf8bce55fe66b7daf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:44.711630 29859 tablet_service.cc:1467] Processing CreateTablet for tablet 2af600032a3d4cf8bce55fe66b7daf64 (DEFAULT_TABLE table=test-table [id=a5bac30f43db4555a841c4ad62213e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:44.712040 29624 tablet_service.cc:1467] Processing CreateTablet for tablet 2af600032a3d4cf8bce55fe66b7daf64 (DEFAULT_TABLE table=test-table [id=a5bac30f43db4555a841c4ad62213e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:44.712729 29859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af600032a3d4cf8bce55fe66b7daf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:44.713023 29624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af600032a3d4cf8bce55fe66b7daf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:44.718480 29991 tablet_bootstrap.cc:492] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Bootstrap starting.
I20260807 04:59:44.721057 29994 tablet_bootstrap.cc:492] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Bootstrap starting.
I20260807 04:59:44.721693 29991 tablet_bootstrap.cc:654] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:44.722433 29991 log.cc:824] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:44.722949 29994 tablet_bootstrap.cc:654] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:44.723670 29994 log.cc:824] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:44.724414 29992 tablet_bootstrap.cc:492] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Bootstrap starting.
I20260807 04:59:44.724485 29991 tablet_bootstrap.cc:492] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: No bootstrap required, opened a new log
I20260807 04:59:44.724684 29991 ts_tablet_manager.cc:1397] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 04:59:44.725692 29994 tablet_bootstrap.cc:492] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: No bootstrap required, opened a new log
I20260807 04:59:44.725894 29994 ts_tablet_manager.cc:1397] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 04:59:44.726488 29992 tablet_bootstrap.cc:654] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:44.727165 29992 log.cc:824] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:44.729019 29992 tablet_bootstrap.cc:492] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: No bootstrap required, opened a new log
I20260807 04:59:44.728807 29991 raft_consensus.cc:348] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.729087 29991 raft_consensus.cc:374] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:44.729135 29991 raft_consensus.cc:729] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Initialized, Role: FOLLOWER
I20260807 04:59:44.729187 29992 ts_tablet_manager.cc:1397] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 04:59:44.729642 29991 consensus_queue.cc:260] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.729700 29994 raft_consensus.cc:348] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.729944 29994 raft_consensus.cc:374] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:44.729995 29994 raft_consensus.cc:729] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7adc892caf34167a6e4e83b13ada879, State: Initialized, Role: FOLLOWER
I20260807 04:59:44.730396 29509 heartbeater.cc:503] Master 127.25.214.254:44431 was elected leader, sending a full tablet report...
I20260807 04:59:44.730384 29994 consensus_queue.cc:260] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.731065 29739 heartbeater.cc:503] Master 127.25.214.254:44431 was elected leader, sending a full tablet report...
I20260807 04:59:44.731367 29994 ts_tablet_manager.cc:1428] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 04:59:44.732306 29991 ts_tablet_manager.cc:1428] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 04:59:44.733212 29992 raft_consensus.cc:348] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.733521 29992 raft_consensus.cc:374] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:44.733579 29992 raft_consensus.cc:729] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, State: Initialized, Role: FOLLOWER
I20260807 04:59:44.734045 29992 consensus_queue.cc:260] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.734804 29949 heartbeater.cc:503] Master 127.25.214.254:44431 was elected leader, sending a full tablet report...
I20260807 04:59:44.735106 29992 ts_tablet_manager.cc:1428] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 04:59:44.773916 30001 raft_consensus.cc:482] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:44.774192 30001 raft_consensus.cc:504] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.775437 30001 leader_election.cc:288] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:44.779258 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.775890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:47181 (local address 127.25.214.195:45523)
0807 04:59:44.776036 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.776040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.776302 (+ 262us) server_negotiation.cc:407] Connection header received
0807 04:59:44.776418 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.776421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.776480 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.776541 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:44.776790 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.777289 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.778340 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.778738 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.778844 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.778901 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.779061 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.779129 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 04:59:44.779277 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.775801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45893 (local address 127.25.214.194:40365)
0807 04:59:44.775932 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.775937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.776193 (+ 256us) server_negotiation.cc:407] Connection header received
0807 04:59:44.776343 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.776347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.776388 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.776462 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:44.776727 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.777234 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.778340 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.778748 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.778858 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.778910 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.779085 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.779154 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 04:59:44.779313 30006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.775679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45523 (local address 127.25.214.193:47181)
0807 04:59:44.776220 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.776232 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.776333 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.776561 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.776564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.776580 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:44.776694 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.776699 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.777390 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.777394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.778227 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.778237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.778844 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.778848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.778939 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.778972 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.779038 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.779110 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":63,"thread_start_us":113,"threads_started":1}
I20260807 04:59:44.779320 30004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.775679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40365 (local address 127.25.214.193:45893)
0807 04:59:44.776097 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.776112 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.776238 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.776487 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.776489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.776505 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:44.776629 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.776634 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.777339 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.777342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.778223 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.778233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.778860 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.778863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.778976 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.778998 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.779062 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.779132 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":35,"thread_start_us":92,"threads_started":1}
I20260807 04:59:44.780057 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af600032a3d4cf8bce55fe66b7daf64" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" is_pre_election: true
I20260807 04:59:44.780191 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af600032a3d4cf8bce55fe66b7daf64" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879" is_pre_election: true
I20260807 04:59:44.780439 29886 raft_consensus.cc:2454] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 0.
I20260807 04:59:44.780476 29660 raft_consensus.cc:2454] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 0.
I20260807 04:59:44.781004 29335 leader_election.cc:302] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, ba9049cf94454db3be9f7682900c5e9d; no voters:
I20260807 04:59:44.781319 30001 raft_consensus.cc:2781] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:44.781404 30001 raft_consensus.cc:482] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:44.781435 30001 raft_consensus.cc:3037] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:44.782523 30001 raft_consensus.cc:504] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.782917 30001 leader_election.cc:288] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 election: Requested vote from peers d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:44.783344 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af600032a3d4cf8bce55fe66b7daf64" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
I20260807 04:59:44.783473 29886 raft_consensus.cc:3037] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:44.783500 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af600032a3d4cf8bce55fe66b7daf64" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879"
I20260807 04:59:44.783707 29660 raft_consensus.cc:3037] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:44.784687 29886 raft_consensus.cc:2454] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 1.
I20260807 04:59:44.784873 29660 raft_consensus.cc:2454] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 1.
I20260807 04:59:44.785100 29335 leader_election.cc:302] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, ba9049cf94454db3be9f7682900c5e9d; no voters:
I20260807 04:59:44.785339 30001 raft_consensus.cc:2781] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:44.785591 30001 raft_consensus.cc:686] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 1 LEADER]: Becoming Leader. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Running, Role: LEADER
I20260807 04:59:44.785970 30001 consensus_queue.cc:237] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.789261 29182 catalog_manager.cc:5495] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d reported cstate change: term changed from 0 to 1, leader changed from <none> to ba9049cf94454db3be9f7682900c5e9d (127.25.214.193). New cstate: current_term: 1 leader_uuid: "ba9049cf94454db3be9f7682900c5e9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } health_report { overall_health: UNKNOWN } } }
Aug 07 04:59:44 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078783, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:44.830358 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.821967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:44431 (local address 127.0.0.1:42628)
0807 04:59:44.822274 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:44.822290 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:44.822406 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:44.822700 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:44.822702 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:44.823109 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:44.823211 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.823217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.823945 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.823948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.824573 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:44.824583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.824958 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.824961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:44.825019 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.825551 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:44.825562 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:44.826973 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:44.828619 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.828631 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.828637 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.828949 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.829165 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:44.829168 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:44.829170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:44.829274 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:44.829688 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:44.829694 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:44.829867 (+ 173us) client_negotiation.cc:769] Sending connection context
0807 04:59:44.829986 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 04:59:44.830167 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260807 04:59:44.830359 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:44.822052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42628 (local address 127.25.214.254:44431)
0807 04:59:44.822196 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:44.822200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:44.822359 (+ 159us) server_negotiation.cc:407] Connection header received
0807 04:59:44.822541 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:44.822544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:44.822591 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:44.822672 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:44.823305 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.823831 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.824673 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:44.824875 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:44.824948 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:44.827137 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:44.827141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:44.827143 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:44.827166 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:44.828482 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.829033 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.829035 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.829036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.829104 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:44.829344 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:44.829347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:44.829348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:44.829553 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:44.829627 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:44.830020 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 04:59:44.830227 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":62}
I20260807 04:59:44.834334 29182 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42628:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 04:59:44.835047 29182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:44.839982 29406 tablet_service.cc:1467] Processing CreateTablet for tablet f1293d77c35242b4bbee98e87064bd7b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b30940036a4949c2aa825bdd83f8401f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:59:44.840236 29859 tablet_service.cc:1467] Processing CreateTablet for tablet f1293d77c35242b4bbee98e87064bd7b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b30940036a4949c2aa825bdd83f8401f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:59:44.840236 29624 tablet_service.cc:1467] Processing CreateTablet for tablet f1293d77c35242b4bbee98e87064bd7b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b30940036a4949c2aa825bdd83f8401f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:59:44.840718 29406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1293d77c35242b4bbee98e87064bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:44.840925 29624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1293d77c35242b4bbee98e87064bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:44.840934 29859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1293d77c35242b4bbee98e87064bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:44.843277 29991 tablet_bootstrap.cc:492] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: Bootstrap starting.
I20260807 04:59:44.843904 29992 tablet_bootstrap.cc:492] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Bootstrap starting.
I20260807 04:59:44.843924 29994 tablet_bootstrap.cc:492] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: Bootstrap starting.
I20260807 04:59:44.844380 29991 tablet_bootstrap.cc:654] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:44.844902 29994 tablet_bootstrap.cc:654] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:44.844931 29992 tablet_bootstrap.cc:654] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:44.846050 29991 tablet_bootstrap.cc:492] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: No bootstrap required, opened a new log
I20260807 04:59:44.846154 29991 ts_tablet_manager.cc:1397] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:59:44.846498 29992 tablet_bootstrap.cc:492] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: No bootstrap required, opened a new log
I20260807 04:59:44.846590 29992 ts_tablet_manager.cc:1397] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:59:44.846690 29991 raft_consensus.cc:348] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.846827 29991 raft_consensus.cc:374] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:44.846868 29991 raft_consensus.cc:729] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Initialized, Role: FOLLOWER
I20260807 04:59:44.847005 29991 consensus_queue.cc:260] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.847075 29992 raft_consensus.cc:348] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.847182 29992 raft_consensus.cc:374] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:44.847210 29992 raft_consensus.cc:729] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, State: Initialized, Role: FOLLOWER
I20260807 04:59:44.847302 29991 ts_tablet_manager.cc:1428] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 04:59:44.847328 29992 consensus_queue.cc:260] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.847297 30001 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:44.847571 30001 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:44.847625 29992 ts_tablet_manager.cc:1428] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:44.848353 29994 tablet_bootstrap.cc:492] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: No bootstrap required, opened a new log
I20260807 04:59:44.848443 29994 ts_tablet_manager.cc:1397] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 04:59:44.847627 30003 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:44.848839 30003 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:44.848932 29994 raft_consensus.cc:348] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.849049 29994 raft_consensus.cc:374] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:44.849084 29994 raft_consensus.cc:729] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7adc892caf34167a6e4e83b13ada879, State: Initialized, Role: FOLLOWER
I20260807 04:59:44.849205 29994 consensus_queue.cc:260] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:44.849445 29994 ts_tablet_manager.cc:1428] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 04:59:44.849597 30002 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:44.849745 30002 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 04:59:44.898788 29950 tablet.cc:2369] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:59:44.926139 29741 tablet.cc:2369] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:59:44.960037 29510 tablet.cc:2369] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:59:45.121071 30003 raft_consensus.cc:482] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:45.121232 30003 raft_consensus.cc:504] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.122402 30003 leader_election.cc:288] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199), d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365)
I20260807 04:59:45.126112 29790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.122669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:38199 (local address 127.25.214.195:43773)
0807 04:59:45.122883 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.122900 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.122997 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.123263 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.123266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.123282 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:45.123406 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.123414 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.124238 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.124242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.125039 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.125048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.125706 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.125709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.125815 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.125832 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.125903 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.125969 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":1}
I20260807 04:59:45.126112 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.122752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:56643 (local address 127.25.214.194:40365)
0807 04:59:45.122903 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.122908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.123167 (+ 259us) server_negotiation.cc:407] Connection header received
0807 04:59:45.123274 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.123276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.123320 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.123398 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:45.123640 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.124149 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.125185 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.125563 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.125669 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.125726 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.125904 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.125979 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:59:45.126117 29982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.122749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:43773 (local address 127.25.214.193:38199)
0807 04:59:45.122923 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.122927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.122947 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:59:45.123107 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.123112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.123166 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.123243 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:45.123551 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.124122 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.125162 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.125567 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.125672 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.125725 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.125935 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.126006 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 04:59:45.126137 30026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.122669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40365 (local address 127.25.214.195:56643)
0807 04:59:45.123066 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.123080 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.123183 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.123408 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.123410 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.123424 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:45.123541 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.123546 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.124257 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.124261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.125069 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.125078 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.125697 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.125701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.125791 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.125811 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.125870 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.125936 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":57,"thread_start_us":72,"threads_started":1}
I20260807 04:59:45.126665 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1293d77c35242b4bbee98e87064bd7b" candidate_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879" is_pre_election: true
I20260807 04:59:45.126807 29660 raft_consensus.cc:2454] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeccdfe7bb3f4f2a97e7cb7ee66aa51d in term 0.
I20260807 04:59:45.126865 29443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1293d77c35242b4bbee98e87064bd7b" candidate_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9049cf94454db3be9f7682900c5e9d" is_pre_election: true
I20260807 04:59:45.127118 29443 raft_consensus.cc:2454] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeccdfe7bb3f4f2a97e7cb7ee66aa51d in term 0.
I20260807 04:59:45.127157 29779 leader_election.cc:302] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, d7adc892caf34167a6e4e83b13ada879; no voters:
I20260807 04:59:45.127476 30003 raft_consensus.cc:2781] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:45.127537 30003 raft_consensus.cc:482] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:45.127565 30003 raft_consensus.cc:3037] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:45.128619 30003 raft_consensus.cc:504] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.128988 30003 leader_election.cc:288] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [CANDIDATE]: Term 1 election: Requested vote from peers ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199), d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365)
I20260807 04:59:45.129316 29443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1293d77c35242b4bbee98e87064bd7b" candidate_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9049cf94454db3be9f7682900c5e9d"
I20260807 04:59:45.129428 29443 raft_consensus.cc:3037] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:45.129424 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1293d77c35242b4bbee98e87064bd7b" candidate_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879"
I20260807 04:59:45.129585 29660 raft_consensus.cc:3037] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:45.130367 29443 raft_consensus.cc:2454] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeccdfe7bb3f4f2a97e7cb7ee66aa51d in term 1.
I20260807 04:59:45.130498 29660 raft_consensus.cc:2454] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeccdfe7bb3f4f2a97e7cb7ee66aa51d in term 1.
I20260807 04:59:45.130656 29776 leader_election.cc:302] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, ba9049cf94454db3be9f7682900c5e9d; no voters:
I20260807 04:59:45.130825 30003 raft_consensus.cc:2781] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:45.131052 30003 raft_consensus.cc:686] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 LEADER]: Becoming Leader. State: Replica: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, State: Running, Role: LEADER
I20260807 04:59:45.131448 30003 consensus_queue.cc:237] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.133841 30027 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: TxnStatusTablet state changed. Reason: New leader aeccdfe7bb3f4f2a97e7cb7ee66aa51d. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.133982 30027 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:59:45.134279 30031 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 04:59:45.134475 30031 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 04:59:45.134711 29181 catalog_manager.cc:5495] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d reported cstate change: term changed from 0 to 1, leader changed from <none> to aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195). New cstate: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } health_report { overall_health: HEALTHY } } }
I20260807 04:59:45.148427 30022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.144189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45523 (local address 127.0.0.1:36280)
0807 04:59:45.144340 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.144355 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.144457 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.144833 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.144836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.144845 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:45.144960 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.144966 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.146002 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.146005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.146629 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.146638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.147243 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.147246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.147322 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.147370 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.148174 (+ 804us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.148184 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.148236 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.148306 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 04:59:45.148448 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.144283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36280 (local address 127.25.214.195:45523)
0807 04:59:45.144420 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.144425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.144443 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:59:45.144590 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.144594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.144664 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.144782 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.145085 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.145877 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.146748 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.147102 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.147215 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.147508 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.148056 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.148198 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.148252 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.148312 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 04:59:45.153960 29660 raft_consensus.cc:1261] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Refusing update from remote peer aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:45.153966 29443 raft_consensus.cc:1261] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Refusing update from remote peer aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:45.154664 30003 consensus_queue.cc:1035] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:45.154844 30027 consensus_queue.cc:1035] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:45.158484 30001 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: TxnStatusTablet state changed. Reason: New leader aeccdfe7bb3f4f2a97e7cb7ee66aa51d. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.158612 30001 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:45.159168 30002 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: TxnStatusTablet state changed. Reason: New leader aeccdfe7bb3f4f2a97e7cb7ee66aa51d. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.159283 30002 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:45.161306 30003 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.161422 30003 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:59:45.162091 30040 mvcc.cc:205] Tried to move back new op lower bound from 7315778703983136768 to 7315778703901270016. Current Snapshot: MvccSnapshot[applied={T|T < 7315778703983136768}]
I20260807 04:59:45.162467 30003 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.162572 30003 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:59:45.163197 30002 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.163306 30002 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P d7adc892caf34167a6e4e83b13ada879: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:45.164176 30001 tablet_replica.cc:439] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } } }
I20260807 04:59:45.164285 30001 tablet_replica.cc:442] T f1293d77c35242b4bbee98e87064bd7b P ba9049cf94454db3be9f7682900c5e9d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:59:45.167778 30043 mvcc.cc:205] Tried to move back new op lower bound from 7315778703983136768 to 7315778703901270016. Current Snapshot: MvccSnapshot[applied={T|T < 7315778703983136768}]
I20260807 04:59:45.173207 29982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.169865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49656 (local address 127.25.214.193:38199)
0807 04:59:45.169965 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.169969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.170016 (+ 47us) server_negotiation.cc:407] Connection header received
0807 04:59:45.170199 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.170201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.170250 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.170333 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.170587 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.171078 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.171880 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.172134 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.172222 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.172472 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.172854 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.172952 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.173026 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.173079 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 04:59:45.184315 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.181191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:38355 (local address 127.25.214.195:45523)
0807 04:59:45.181306 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.181311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.181488 (+ 177us) server_negotiation.cc:407] Connection header received
0807 04:59:45.181610 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.181614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.181658 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.181718 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.181963 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.182448 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.183278 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.183484 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.183577 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.183872 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.183943 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.183997 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.184119 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.184171 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 04:59:45.184331 30057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.181104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45523 (local address 127.25.214.193:38355)
0807 04:59:45.181413 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.181424 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.181524 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.181735 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.181738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.181745 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:45.181866 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.181871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.182545 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.182548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.183167 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.183176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.183580 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.183584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.183673 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.183717 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.184012 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.184018 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.184102 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.184176 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":95,"threads_started":1}
I20260807 04:59:45.191128 29660 raft_consensus.cc:1261] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Refusing update from remote peer ba9049cf94454db3be9f7682900c5e9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:45.191383 29886 raft_consensus.cc:1261] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Refusing update from remote peer ba9049cf94454db3be9f7682900c5e9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:45.191977 30007 consensus_queue.cc:1035] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:45.192169 30001 consensus_queue.cc:1035] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:45.204427 30042 mvcc.cc:205] Tried to move back new op lower bound from 7315778704138412032 to 7315778702486216704. Current Snapshot: MvccSnapshot[applied={T|T < 7315778704138412032}]
I20260807 04:59:45.219861 29982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.214387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:60443 (local address 127.25.214.193:38199)
0807 04:59:45.214568 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.214573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.214969 (+ 396us) server_negotiation.cc:407] Connection header received
0807 04:59:45.215130 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.215133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.215187 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.215268 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.216119 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.216930 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.218690 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.219054 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.219160 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.219434 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.219522 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.219592 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.219662 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.219719 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:59:45.220366 30065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.214025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:38199 (local address 127.25.214.195:60443)
0807 04:59:45.214876 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.214890 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.215008 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.215442 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.215445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.215454 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:45.215591 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.215598 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.217322 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.217325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.218556 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.218569 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.219161 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.219164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.219256 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.219311 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.219596 (+ 285us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.219601 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.219652 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.219726 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":95,"threads_started":1}
I20260807 04:59:45.250877 29181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:45.251092 29181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:45.253973 29181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Sending DeleteTablet for 3 replicas of tablet 2af600032a3d4cf8bce55fe66b7daf64
I20260807 04:59:45.254810 29406 tablet_service.cc:1514] Processing DeleteTablet for tablet 2af600032a3d4cf8bce55fe66b7daf64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:45 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:49646
I20260807 04:59:45.254907 29624 tablet_service.cc:1514] Processing DeleteTablet for tablet 2af600032a3d4cf8bce55fe66b7daf64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:45 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:44902
I20260807 04:59:45.255375 30070 tablet_replica.cc:330] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: stopping tablet replica
I20260807 04:59:45.255610 29859 tablet_service.cc:1514] Processing DeleteTablet for tablet 2af600032a3d4cf8bce55fe66b7daf64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:45 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:36272
I20260807 04:59:45.255703 30070 raft_consensus.cc:2229] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:45.255927 30070 raft_consensus.cc:2258] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:45.256382 30068 tablet_replica.cc:330] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: stopping tablet replica
I20260807 04:59:45.257077 29181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:59:45.257565 29181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:45.257797 30070 ts_tablet_manager.cc:1905] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:45.256621 30071 tablet_replica.cc:330] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: stopping tablet replica
I20260807 04:59:45.258867 30071 raft_consensus.cc:2229] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:45.259044 30071 raft_consensus.cc:2258] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:45.261336 30070 ts_tablet_manager.cc:1918] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:45.261442 30070 log.cc:1196] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/2af600032a3d4cf8bce55fe66b7daf64
I20260807 04:59:45.261816 30070 ts_tablet_manager.cc:1939] T 2af600032a3d4cf8bce55fe66b7daf64 P d7adc892caf34167a6e4e83b13ada879: Deleting consensus metadata
I20260807 04:59:45.263214 29164 catalog_manager.cc:4841] TS d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365): tablet 2af600032a3d4cf8bce55fe66b7daf64 (table test-table [id=a5bac30f43db4555a841c4ad62213e80]) successfully deleted
I20260807 04:59:45.264998 29624 tablet_service.cc:1467] Processing CreateTablet for tablet aa0a6ca4e8784a34b85b74850bd2da47 (DEFAULT_TABLE table=test-table [id=818230185cf14f039383b0925bf37717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:45.265257 29624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa0a6ca4e8784a34b85b74850bd2da47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:45.265233 29859 tablet_service.cc:1467] Processing CreateTablet for tablet aa0a6ca4e8784a34b85b74850bd2da47 (DEFAULT_TABLE table=test-table [id=818230185cf14f039383b0925bf37717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:45.265506 29859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa0a6ca4e8784a34b85b74850bd2da47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:45.267602 29994 tablet_bootstrap.cc:492] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Bootstrap starting.
I20260807 04:59:45.267774 29992 tablet_bootstrap.cc:492] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Bootstrap starting.
I20260807 04:59:45.264504 29406 tablet_service.cc:1467] Processing CreateTablet for tablet aa0a6ca4e8784a34b85b74850bd2da47 (DEFAULT_TABLE table=test-table [id=818230185cf14f039383b0925bf37717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:45.268414 30068 raft_consensus.cc:2229] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:59:45.268532 29406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa0a6ca4e8784a34b85b74850bd2da47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:45.268553 29994 tablet_bootstrap.cc:654] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:45.268826 30068 raft_consensus.cc:2258] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:45.269948 29994 tablet_bootstrap.cc:492] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: No bootstrap required, opened a new log
I20260807 04:59:45.270027 29994 ts_tablet_manager.cc:1397] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:45.270252 30071 ts_tablet_manager.cc:1905] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:45.270437 29994 raft_consensus.cc:348] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.270567 29994 raft_consensus.cc:374] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:45.270599 29994 raft_consensus.cc:729] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7adc892caf34167a6e4e83b13ada879, State: Initialized, Role: FOLLOWER
I20260807 04:59:45.270715 29994 consensus_queue.cc:260] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.270984 29994 ts_tablet_manager.cc:1428] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:45.271057 29991 tablet_bootstrap.cc:492] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Bootstrap starting.
I20260807 04:59:45.271988 29991 tablet_bootstrap.cc:654] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:45.273334 30071 ts_tablet_manager.cc:1918] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:45.273422 30071 log.cc:1196] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/2af600032a3d4cf8bce55fe66b7daf64
I20260807 04:59:45.273626 29992 tablet_bootstrap.cc:654] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:45.273692 30071 ts_tablet_manager.cc:1939] T 2af600032a3d4cf8bce55fe66b7daf64 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting consensus metadata
I20260807 04:59:45.274771 29992 tablet_bootstrap.cc:492] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: No bootstrap required, opened a new log
I20260807 04:59:45.274888 29992 ts_tablet_manager.cc:1397] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 04:59:45.274875 29159 catalog_manager.cc:4841] TS aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523): tablet 2af600032a3d4cf8bce55fe66b7daf64 (table test-table [id=a5bac30f43db4555a841c4ad62213e80]) successfully deleted
I20260807 04:59:45.275382 29992 raft_consensus.cc:348] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.275490 29992 raft_consensus.cc:374] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:45.275497 29991 tablet_bootstrap.cc:492] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: No bootstrap required, opened a new log
I20260807 04:59:45.275522 29992 raft_consensus.cc:729] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, State: Initialized, Role: FOLLOWER
I20260807 04:59:45.275570 29991 ts_tablet_manager.cc:1397] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 04:59:45.275640 29992 consensus_queue.cc:260] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.275889 29992 ts_tablet_manager.cc:1428] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:45.276005 29991 raft_consensus.cc:348] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.276147 29991 raft_consensus.cc:374] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:45.276185 29991 raft_consensus.cc:729] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Initialized, Role: FOLLOWER
I20260807 04:59:45.276286 29991 consensus_queue.cc:260] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.276522 29991 ts_tablet_manager.cc:1428] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:45.280745 30068 ts_tablet_manager.cc:1905] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:45.283833 30068 ts_tablet_manager.cc:1918] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:45.283951 30068 log.cc:1196] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/2af600032a3d4cf8bce55fe66b7daf64
I20260807 04:59:45.284286 30068 ts_tablet_manager.cc:1939] T 2af600032a3d4cf8bce55fe66b7daf64 P ba9049cf94454db3be9f7682900c5e9d: Deleting consensus metadata
I20260807 04:59:45.285481 29159 catalog_manager.cc:4841] TS ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199): tablet 2af600032a3d4cf8bce55fe66b7daf64 (table test-table [id=a5bac30f43db4555a841c4ad62213e80]) successfully deleted
I20260807 04:59:45.313779 30002 raft_consensus.cc:482] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:45.313958 30002 raft_consensus.cc:504] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.315115 30002 leader_election.cc:288] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:45.319720 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.315911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:40733 (local address 127.25.214.195:45523)
0807 04:59:45.316045 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.316050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.316270 (+ 220us) server_negotiation.cc:407] Connection header received
0807 04:59:45.316412 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.316415 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.316462 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.316535 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:45.316884 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.317567 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.318636 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.319145 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.319261 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.319318 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.319511 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.319591 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:59:45.319736 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.315791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45523 (local address 127.25.214.194:40733)
0807 04:59:45.316176 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.316190 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.316294 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.316639 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.316642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.316657 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:45.316757 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.316763 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.317675 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.317678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.318511 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.318521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.319278 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.319282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.319379 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.319407 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.319481 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.319554 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":1,"thread_start_us":114,"threads_started":1}
I20260807 04:59:45.320223 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa0a6ca4e8784a34b85b74850bd2da47" candidate_uuid: "d7adc892caf34167a6e4e83b13ada879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" is_pre_election: true
I20260807 04:59:45.320393 29886 raft_consensus.cc:2454] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7adc892caf34167a6e4e83b13ada879 in term 0.
I20260807 04:59:45.320538 29982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.315455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:49049 (local address 127.25.214.193:38199)
0807 04:59:45.315587 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.315592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.315764 (+ 172us) server_negotiation.cc:407] Connection header received
0807 04:59:45.316054 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.316057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.316142 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.316186 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:59:45.316586 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.317343 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.318899 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.319434 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.319551 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.319597 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.320338 (+ 741us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.320418 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 04:59:45.320672 30079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.315374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:38199 (local address 127.25.214.194:49049)
0807 04:59:45.315678 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.315691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.315851 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.316326 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.316330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.316350 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:59:45.316463 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.316469 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.317439 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.317442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.318771 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.318782 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.319659 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.319662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.319749 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.319771 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.320307 (+ 536us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.320542 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":27,"thread_start_us":132,"threads_started":1}
I20260807 04:59:45.321017 29541 leader_election.cc:302] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, d7adc892caf34167a6e4e83b13ada879; no voters:
I20260807 04:59:45.321084 29443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa0a6ca4e8784a34b85b74850bd2da47" candidate_uuid: "d7adc892caf34167a6e4e83b13ada879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9049cf94454db3be9f7682900c5e9d" is_pre_election: true
I20260807 04:59:45.321197 29443 raft_consensus.cc:2454] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7adc892caf34167a6e4e83b13ada879 in term 0.
I20260807 04:59:45.321316 30002 raft_consensus.cc:2781] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:45.321377 30002 raft_consensus.cc:482] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:45.321416 30002 raft_consensus.cc:3037] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:45.322458 30002 raft_consensus.cc:504] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.322810 30002 leader_election.cc:288] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [CANDIDATE]: Term 1 election: Requested vote from peers ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:45.323230 29443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa0a6ca4e8784a34b85b74850bd2da47" candidate_uuid: "d7adc892caf34167a6e4e83b13ada879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9049cf94454db3be9f7682900c5e9d"
I20260807 04:59:45.323218 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa0a6ca4e8784a34b85b74850bd2da47" candidate_uuid: "d7adc892caf34167a6e4e83b13ada879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
I20260807 04:59:45.323333 29443 raft_consensus.cc:3037] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:45.323342 29886 raft_consensus.cc:3037] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:45.324326 29443 raft_consensus.cc:2454] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7adc892caf34167a6e4e83b13ada879 in term 1.
I20260807 04:59:45.324533 29886 raft_consensus.cc:2454] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7adc892caf34167a6e4e83b13ada879 in term 1.
I20260807 04:59:45.324617 29541 leader_election.cc:302] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba9049cf94454db3be9f7682900c5e9d, d7adc892caf34167a6e4e83b13ada879; no voters:
I20260807 04:59:45.324908 30002 raft_consensus.cc:2781] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:45.325119 30002 raft_consensus.cc:686] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 1 LEADER]: Becoming Leader. State: Replica: d7adc892caf34167a6e4e83b13ada879, State: Running, Role: LEADER
I20260807 04:59:45.325390 30002 consensus_queue.cc:237] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:45.327900 29181 catalog_manager.cc:5495] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7adc892caf34167a6e4e83b13ada879 (127.25.214.194). New cstate: current_term: 1 leader_uuid: "d7adc892caf34167a6e4e83b13ada879" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } health_report { overall_health: UNKNOWN } } }
I20260807 04:59:45.355875 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.352267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44918 (local address 127.25.214.194:40365)
0807 04:59:45.352397 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.352401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.352436 (+ 35us) server_negotiation.cc:407] Connection header received
0807 04:59:45.352603 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.352605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.352657 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.352738 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.352961 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.353446 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.354562 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.354765 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.354829 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.355101 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.355524 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.355607 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.355701 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.355747 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 04:59:45.366739 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.363500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:37663 (local address 127.25.214.195:45523)
0807 04:59:45.363640 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.363645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.363778 (+ 133us) server_negotiation.cc:407] Connection header received
0807 04:59:45.363938 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.363941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.363990 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.364050 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.364336 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.364863 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.365697 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.365921 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.366007 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.366289 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.366372 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.366430 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.366518 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.366575 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:59:45.366993 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.363356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45523 (local address 127.25.214.194:37663)
0807 04:59:45.363692 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.363705 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.363822 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.364068 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.364071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.364098 (+ 27us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:45.364218 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.364224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.364966 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.364970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.365583 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.365592 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.366021 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.366024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.366113 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.366159 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.366443 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.366450 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.366510 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.366589 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":113,"threads_started":1}
I20260807 04:59:45.373801 29443 raft_consensus.cc:1261] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Refusing update from remote peer d7adc892caf34167a6e4e83b13ada879: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:45.373798 29886 raft_consensus.cc:1261] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Refusing update from remote peer d7adc892caf34167a6e4e83b13ada879: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:45.374290 30002 consensus_queue.cc:1035] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:45.374506 30088 consensus_queue.cc:1035] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:45.393906 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.390729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:44545 (local address 127.25.214.194:40365)
0807 04:59:45.390847 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:45.390851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:45.390866 (+ 15us) server_negotiation.cc:407] Connection header received
0807 04:59:45.390969 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:45.390972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:45.391022 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:45.391083 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:45.391419 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.392056 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.392921 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.393144 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.393227 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.393490 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.393563 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.393619 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:45.393707 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 04:59:45.393759 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 04:59:45.393906 30065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:45.390660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40365 (local address 127.25.214.195:44545)
0807 04:59:45.390780 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:45.390794 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:45.390872 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:45.391199 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:45.391202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:45.391210 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:59:45.391317 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.391324 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.392220 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.392224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.392811 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:45.392820 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:45.393236 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:45.393239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:45.393324 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:45.393387 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:59:45.393633 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:59:45.393640 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 04:59:45.393698 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 04:59:45.393781 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 04:59:45.394683 30062 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 04:59:46.961236 29181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:46.961427 29181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:46.963908 29181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Sending DeleteTablet for 3 replicas of tablet aa0a6ca4e8784a34b85b74850bd2da47
I20260807 04:59:46.964516 29406 tablet_service.cc:1514] Processing DeleteTablet for tablet aa0a6ca4e8784a34b85b74850bd2da47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:46 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:49646
I20260807 04:59:46.964560 29624 tablet_service.cc:1514] Processing DeleteTablet for tablet aa0a6ca4e8784a34b85b74850bd2da47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:46 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:44902
I20260807 04:59:46.964854 29858 tablet_service.cc:1514] Processing DeleteTablet for tablet aa0a6ca4e8784a34b85b74850bd2da47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:46 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:36272
I20260807 04:59:46.964890 30143 tablet_replica.cc:330] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: stopping tablet replica
I20260807 04:59:46.965129 30143 raft_consensus.cc:2229] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:46.965260 30143 raft_consensus.cc:2258] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:46.965480 30142 tablet_replica.cc:330] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: stopping tablet replica
I20260807 04:59:46.965588 30146 tablet_replica.cc:330] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: stopping tablet replica
I20260807 04:59:46.965600 30142 raft_consensus.cc:2229] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:59:46.965723 30146 raft_consensus.cc:2229] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:46.965847 30146 raft_consensus.cc:2258] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:46.965912 30142 raft_consensus.cc:2258] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:46.966182 30143 ts_tablet_manager.cc:1905] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:46.966547 30142 ts_tablet_manager.cc:1905] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:46.966639 30146 ts_tablet_manager.cc:1905] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:46.969046 30142 ts_tablet_manager.cc:1918] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:59:46.969096 30143 ts_tablet_manager.cc:1918] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:59:46.969096 30146 ts_tablet_manager.cc:1918] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:59:46.969121 30142 log.cc:1196] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/aa0a6ca4e8784a34b85b74850bd2da47
I20260807 04:59:46.969166 30146 log.cc:1196] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/aa0a6ca4e8784a34b85b74850bd2da47
I20260807 04:59:46.969166 30143 log.cc:1196] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/aa0a6ca4e8784a34b85b74850bd2da47
I20260807 04:59:46.969398 30142 ts_tablet_manager.cc:1939] T aa0a6ca4e8784a34b85b74850bd2da47 P d7adc892caf34167a6e4e83b13ada879: Deleting consensus metadata
I20260807 04:59:46.969451 30146 ts_tablet_manager.cc:1939] T aa0a6ca4e8784a34b85b74850bd2da47 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting consensus metadata
I20260807 04:59:46.969457 30143 ts_tablet_manager.cc:1939] T aa0a6ca4e8784a34b85b74850bd2da47 P ba9049cf94454db3be9f7682900c5e9d: Deleting consensus metadata
I20260807 04:59:46.970134 29159 catalog_manager.cc:4841] TS aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523): tablet aa0a6ca4e8784a34b85b74850bd2da47 (table test-table [id=818230185cf14f039383b0925bf37717]) successfully deleted
I20260807 04:59:46.970141 29164 catalog_manager.cc:4841] TS d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365): tablet aa0a6ca4e8784a34b85b74850bd2da47 (table test-table [id=818230185cf14f039383b0925bf37717]) successfully deleted
I20260807 04:59:46.970329 29159 catalog_manager.cc:4841] TS ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199): tablet aa0a6ca4e8784a34b85b74850bd2da47 (table test-table [id=818230185cf14f039383b0925bf37717]) successfully deleted
Aug 07 04:59:46 dist-test-slave-lgr5 krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:59:46 dist-test-slave-lgr5 krb5kdc[29103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:46.995903 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:46.987331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42642 (local address 127.25.214.254:44431)
0807 04:59:46.987646 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:46.987652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:46.987670 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:59:46.987720 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:46.987722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:46.987765 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:46.987858 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:46.988570 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:46.989141 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:46.990061 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:46.990293 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:46.990378 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:46.992909 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:46.992912 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:46.992914 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:46.992942 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:46.994356 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:46.994858 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:46.994860 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:46.994862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:46.994951 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:46.995184 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:46.995186 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:46.995187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:46.995358 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:46.995462 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:46.995650 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 04:59:46.995756 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":125,"threads_started":1}
I20260807 04:59:46.998631 29181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:59:46.999105 29181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:47.004305 29406 tablet_service.cc:1467] Processing CreateTablet for tablet e6453474bccc4984ab8b17b5a12db6d0 (DEFAULT_TABLE table=test-table [id=57d57bd536014a26a697a7047f09b6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:47.004347 29624 tablet_service.cc:1467] Processing CreateTablet for tablet e6453474bccc4984ab8b17b5a12db6d0 (DEFAULT_TABLE table=test-table [id=57d57bd536014a26a697a7047f09b6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:47.004495 29858 tablet_service.cc:1467] Processing CreateTablet for tablet e6453474bccc4984ab8b17b5a12db6d0 (DEFAULT_TABLE table=test-table [id=57d57bd536014a26a697a7047f09b6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:47.004668 29406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6453474bccc4984ab8b17b5a12db6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:47.004671 29624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6453474bccc4984ab8b17b5a12db6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:47.004747 29858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6453474bccc4984ab8b17b5a12db6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:47.006743 30158 tablet_bootstrap.cc:492] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Bootstrap starting.
I20260807 04:59:47.007158 30160 tablet_bootstrap.cc:492] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Bootstrap starting.
I20260807 04:59:47.007725 30158 tablet_bootstrap.cc:654] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:47.007964 30161 tablet_bootstrap.cc:492] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Bootstrap starting.
I20260807 04:59:47.008127 30160 tablet_bootstrap.cc:654] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:47.008859 30161 tablet_bootstrap.cc:654] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:47.008929 30158 tablet_bootstrap.cc:492] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: No bootstrap required, opened a new log
I20260807 04:59:47.009028 30158 ts_tablet_manager.cc:1397] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:47.009383 30158 raft_consensus.cc:348] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.009485 30158 raft_consensus.cc:374] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:47.009505 30158 raft_consensus.cc:729] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Initialized, Role: FOLLOWER
I20260807 04:59:47.009655 30158 consensus_queue.cc:260] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.009927 30161 tablet_bootstrap.cc:492] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: No bootstrap required, opened a new log
I20260807 04:59:47.010016 30161 ts_tablet_manager.cc:1397] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 04:59:47.010015 30158 ts_tablet_manager.cc:1428] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:47.010428 30161 raft_consensus.cc:348] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.010538 30161 raft_consensus.cc:374] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:47.010581 30161 raft_consensus.cc:729] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7adc892caf34167a6e4e83b13ada879, State: Initialized, Role: FOLLOWER
I20260807 04:59:47.010703 30161 consensus_queue.cc:260] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.010963 30161 ts_tablet_manager.cc:1428] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 04:59:47.011116 30160 tablet_bootstrap.cc:492] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: No bootstrap required, opened a new log
I20260807 04:59:47.011222 30160 ts_tablet_manager.cc:1397] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 04:59:47.011830 30160 raft_consensus.cc:348] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.011967 30160 raft_consensus.cc:374] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:47.012008 30160 raft_consensus.cc:729] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, State: Initialized, Role: FOLLOWER
I20260807 04:59:47.012174 30160 consensus_queue.cc:260] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.012427 30160 ts_tablet_manager.cc:1428] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260807 04:59:47.056913 30167 raft_consensus.cc:482] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:47.057104 30167 raft_consensus.cc:504] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.057531 30167 leader_election.cc:288] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:47.057986 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6453474bccc4984ab8b17b5a12db6d0" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" is_pre_election: true
I20260807 04:59:47.057986 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6453474bccc4984ab8b17b5a12db6d0" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879" is_pre_election: true
I20260807 04:59:47.058163 29886 raft_consensus.cc:2454] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 0.
I20260807 04:59:47.058163 29660 raft_consensus.cc:2454] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 0.
I20260807 04:59:47.058483 29335 leader_election.cc:302] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, ba9049cf94454db3be9f7682900c5e9d; no voters:
I20260807 04:59:47.058674 30167 raft_consensus.cc:2781] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:47.058737 30167 raft_consensus.cc:482] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:47.058779 30167 raft_consensus.cc:3037] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:47.059823 30167 raft_consensus.cc:504] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.060220 30167 leader_election.cc:288] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 election: Requested vote from peers d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:47.060606 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6453474bccc4984ab8b17b5a12db6d0" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879"
I20260807 04:59:47.060618 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6453474bccc4984ab8b17b5a12db6d0" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
I20260807 04:59:47.060742 29660 raft_consensus.cc:3037] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:47.060762 29886 raft_consensus.cc:3037] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:47.061730 29660 raft_consensus.cc:2454] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 1.
I20260807 04:59:47.061806 29886 raft_consensus.cc:2454] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 1.
I20260807 04:59:47.062126 29335 leader_election.cc:302] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, ba9049cf94454db3be9f7682900c5e9d; no voters:
I20260807 04:59:47.062317 30167 raft_consensus.cc:2781] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:47.062587 30167 raft_consensus.cc:686] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 1 LEADER]: Becoming Leader. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Running, Role: LEADER
I20260807 04:59:47.062738 30167 consensus_queue.cc:237] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.064477 29182 catalog_manager.cc:5495] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d reported cstate change: term changed from 0 to 1, leader changed from <none> to ba9049cf94454db3be9f7682900c5e9d (127.25.214.193). New cstate: current_term: 1 leader_uuid: "ba9049cf94454db3be9f7682900c5e9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } health_report { overall_health: UNKNOWN } } }
I20260807 04:59:47.081605 30175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:47.078443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49662 (local address 127.25.214.193:38199)
0807 04:59:47.078726 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:47.078735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:47.078748 (+ 13us) server_negotiation.cc:407] Connection header received
0807 04:59:47.078789 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:47.078791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:47.078837 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:47.078910 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:59:47.079160 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:47.079694 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:47.080590 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:47.080814 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:47.080904 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:47.081144 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:59:47.081219 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:59:47.081278 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:47.081384 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 04:59:47.081439 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":106,"threads_started":1}
I20260807 04:59:47.088882 29660 raft_consensus.cc:1261] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Refusing update from remote peer ba9049cf94454db3be9f7682900c5e9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:47.088891 29886 raft_consensus.cc:1261] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Refusing update from remote peer ba9049cf94454db3be9f7682900c5e9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:47.089259 30171 consensus_queue.cc:1035] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:47.089417 30167 consensus_queue.cc:1035] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:47.118475 29183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:47.118638 29183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:47.120654 29183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Sending DeleteTablet for 3 replicas of tablet e6453474bccc4984ab8b17b5a12db6d0
I20260807 04:59:47.121193 29406 tablet_service.cc:1514] Processing DeleteTablet for tablet e6453474bccc4984ab8b17b5a12db6d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:47 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:49646
I20260807 04:59:47.121232 29858 tablet_service.cc:1514] Processing DeleteTablet for tablet e6453474bccc4984ab8b17b5a12db6d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:47 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:36272
I20260807 04:59:47.121212 29624 tablet_service.cc:1514] Processing DeleteTablet for tablet e6453474bccc4984ab8b17b5a12db6d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:47 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:44902
I20260807 04:59:47.121381 30143 tablet_replica.cc:330] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: stopping tablet replica
I20260807 04:59:47.121418 30142 tablet_replica.cc:330] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: stopping tablet replica
I20260807 04:59:47.121505 30143 raft_consensus.cc:2229] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:59:47.121533 30142 raft_consensus.cc:2229] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:47.121651 30142 raft_consensus.cc:2258] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:47.121671 30146 tablet_replica.cc:330] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: stopping tablet replica
I20260807 04:59:47.121707 30143 raft_consensus.cc:2258] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:47.121800 30146 raft_consensus.cc:2229] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:47.121918 30146 raft_consensus.cc:2258] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:47.122512 30142 ts_tablet_manager.cc:1905] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:47.122530 30143 ts_tablet_manager.cc:1905] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:47.122625 30146 ts_tablet_manager.cc:1905] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:47.124769 30146 ts_tablet_manager.cc:1918] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:47.124843 30146 log.cc:1196] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/e6453474bccc4984ab8b17b5a12db6d0
I20260807 04:59:47.125048 30146 ts_tablet_manager.cc:1939] T e6453474bccc4984ab8b17b5a12db6d0 P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting consensus metadata
I20260807 04:59:47.125057 30142 ts_tablet_manager.cc:1918] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:47.125057 30143 ts_tablet_manager.cc:1918] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:59:47.125130 30142 log.cc:1196] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/e6453474bccc4984ab8b17b5a12db6d0
I20260807 04:59:47.125130 30143 log.cc:1196] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/e6453474bccc4984ab8b17b5a12db6d0
I20260807 04:59:47.125375 30142 ts_tablet_manager.cc:1939] T e6453474bccc4984ab8b17b5a12db6d0 P d7adc892caf34167a6e4e83b13ada879: Deleting consensus metadata
I20260807 04:59:47.125375 30143 ts_tablet_manager.cc:1939] T e6453474bccc4984ab8b17b5a12db6d0 P ba9049cf94454db3be9f7682900c5e9d: Deleting consensus metadata
I20260807 04:59:47.125775 29159 catalog_manager.cc:4841] TS aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523): tablet e6453474bccc4984ab8b17b5a12db6d0 (table test-table [id=57d57bd536014a26a697a7047f09b6c5]) successfully deleted
I20260807 04:59:47.125967 29159 catalog_manager.cc:4841] TS ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199): tablet e6453474bccc4984ab8b17b5a12db6d0 (table test-table [id=57d57bd536014a26a697a7047f09b6c5]) successfully deleted
I20260807 04:59:47.126014 29164 catalog_manager.cc:4841] TS d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365): tablet e6453474bccc4984ab8b17b5a12db6d0 (table test-table [id=57d57bd536014a26a697a7047f09b6c5]) successfully deleted
I20260807 04:59:47.125960 29183 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:59:47.126415 29183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:59:47.130932 29406 tablet_service.cc:1467] Processing CreateTablet for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb (DEFAULT_TABLE table=test-table [id=15c8c4aa6653460e80062eef6fac54fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:47.130940 29624 tablet_service.cc:1467] Processing CreateTablet for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb (DEFAULT_TABLE table=test-table [id=15c8c4aa6653460e80062eef6fac54fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:47.131038 29858 tablet_service.cc:1467] Processing CreateTablet for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb (DEFAULT_TABLE table=test-table [id=15c8c4aa6653460e80062eef6fac54fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:59:47.131246 29624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:47.131247 29406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:47.131266 29858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:47.133219 30158 tablet_bootstrap.cc:492] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d: Bootstrap starting.
I20260807 04:59:47.133735 30160 tablet_bootstrap.cc:492] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Bootstrap starting.
I20260807 04:59:47.134207 30158 tablet_bootstrap.cc:654] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:47.134637 30160 tablet_bootstrap.cc:654] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:47.135255 30161 tablet_bootstrap.cc:492] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Bootstrap starting.
I20260807 04:59:47.135509 30158 tablet_bootstrap.cc:492] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d: No bootstrap required, opened a new log
I20260807 04:59:47.135605 30158 ts_tablet_manager.cc:1397] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:47.136051 30158 raft_consensus.cc:348] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.136180 30161 tablet_bootstrap.cc:654] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:47.136222 30158 raft_consensus.cc:374] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:47.136262 30158 raft_consensus.cc:729] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Initialized, Role: FOLLOWER
I20260807 04:59:47.136404 30158 consensus_queue.cc:260] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.136700 30158 ts_tablet_manager.cc:1428] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 04:59:47.137135 30160 tablet_bootstrap.cc:492] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: No bootstrap required, opened a new log
I20260807 04:59:47.137241 30160 ts_tablet_manager.cc:1397] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260807 04:59:47.137595 30161 tablet_bootstrap.cc:492] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: No bootstrap required, opened a new log
I20260807 04:59:47.137697 30161 ts_tablet_manager.cc:1397] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 04:59:47.137732 30160 raft_consensus.cc:348] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.137880 30160 raft_consensus.cc:374] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:47.137913 30160 raft_consensus.cc:729] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, State: Initialized, Role: FOLLOWER
I20260807 04:59:47.138041 30160 consensus_queue.cc:260] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.138190 30161 raft_consensus.cc:348] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.138302 30161 raft_consensus.cc:374] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:47.138322 30160 ts_tablet_manager.cc:1428] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260807 04:59:47.138334 30161 raft_consensus.cc:729] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7adc892caf34167a6e4e83b13ada879, State: Initialized, Role: FOLLOWER
I20260807 04:59:47.138482 30161 consensus_queue.cc:260] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.139499 30161 ts_tablet_manager.cc:1428] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 04:59:47.219954 30182 raft_consensus.cc:482] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:59:47.220124 30182 raft_consensus.cc:504] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.220563 30182 leader_election.cc:288] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:47.221052 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20a55a4d204fedb3c7a1862e8eb5eb" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879" is_pre_election: true
I20260807 04:59:47.221050 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20a55a4d204fedb3c7a1862e8eb5eb" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" is_pre_election: true
I20260807 04:59:47.221208 29886 raft_consensus.cc:2454] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 0.
I20260807 04:59:47.221205 29660 raft_consensus.cc:2454] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 0.
I20260807 04:59:47.221508 29335 leader_election.cc:302] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeccdfe7bb3f4f2a97e7cb7ee66aa51d, ba9049cf94454db3be9f7682900c5e9d; no voters:
I20260807 04:59:47.221700 30182 raft_consensus.cc:2781] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:59:47.221764 30182 raft_consensus.cc:482] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:59:47.221802 30182 raft_consensus.cc:3037] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:47.222849 30182 raft_consensus.cc:504] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.223186 30182 leader_election.cc:288] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 election: Requested vote from peers d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365), aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523)
I20260807 04:59:47.223544 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20a55a4d204fedb3c7a1862e8eb5eb" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7adc892caf34167a6e4e83b13ada879"
I20260807 04:59:47.223603 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20a55a4d204fedb3c7a1862e8eb5eb" candidate_uuid: "ba9049cf94454db3be9f7682900c5e9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d"
I20260807 04:59:47.223661 29660 raft_consensus.cc:3037] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:47.223734 29886 raft_consensus.cc:3037] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:47.224684 29660 raft_consensus.cc:2454] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 1.
I20260807 04:59:47.224924 29886 raft_consensus.cc:2454] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba9049cf94454db3be9f7682900c5e9d in term 1.
I20260807 04:59:47.224977 29337 leader_election.cc:302] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba9049cf94454db3be9f7682900c5e9d, d7adc892caf34167a6e4e83b13ada879; no voters:
I20260807 04:59:47.225292 30182 raft_consensus.cc:2781] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:47.225376 30182 raft_consensus.cc:686] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [term 1 LEADER]: Becoming Leader. State: Replica: ba9049cf94454db3be9f7682900c5e9d, State: Running, Role: LEADER
I20260807 04:59:47.225520 30182 consensus_queue.cc:237] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } }
I20260807 04:59:47.227250 29183 catalog_manager.cc:5495] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d reported cstate change: term changed from 0 to 1, leader changed from <none> to ba9049cf94454db3be9f7682900c5e9d (127.25.214.193). New cstate: current_term: 1 leader_uuid: "ba9049cf94454db3be9f7682900c5e9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba9049cf94454db3be9f7682900c5e9d" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 38199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 } health_report { overall_health: UNKNOWN } } }
I20260807 04:59:47.246975 29886 raft_consensus.cc:1261] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Refusing update from remote peer ba9049cf94454db3be9f7682900c5e9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:47.247344 29660 raft_consensus.cc:1261] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Refusing update from remote peer ba9049cf94454db3be9f7682900c5e9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:59:47.247386 30182 consensus_queue.cc:1035] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeccdfe7bb3f4f2a97e7cb7ee66aa51d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:59:47.247777 30182 consensus_queue.cc:1035] T 5e20a55a4d204fedb3c7a1862e8eb5eb P ba9049cf94454db3be9f7682900c5e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7adc892caf34167a6e4e83b13ada879" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 04:59:47.261349 30111 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 04:59:48.812023 29183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:48.812213 29183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:59:48.814427 29183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1a16c5b671e4ffdaf256561970f40f0: Sending DeleteTablet for 3 replicas of tablet 5e20a55a4d204fedb3c7a1862e8eb5eb
I20260807 04:59:48.814934 29406 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:48 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:49646
I20260807 04:59:48.815021 29624 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:48 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:44902
I20260807 04:59:48.815119 29858 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:59:48 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:36272
I20260807 04:59:48.815450 30230 tablet_replica.cc:330] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: stopping tablet replica
I20260807 04:59:48.815575 30230 raft_consensus.cc:2229] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:48.815572 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29312
I20260807 04:59:48.816146 30230 raft_consensus.cc:2258] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:48.818744 30230 ts_tablet_manager.cc:1905] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:48.820262 30228 tablet_replica.cc:330] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: stopping tablet replica
I20260807 04:59:48.820536 30228 raft_consensus.cc:2229] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:59:48.820660 30228 raft_consensus.cc:2258] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:59:48.821205 30230 ts_tablet_manager.cc:1918] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:59:48.821254 30228 ts_tablet_manager.cc:1905] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:59:48.821290 30230 log.cc:1196] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/5e20a55a4d204fedb3c7a1862e8eb5eb
I20260807 04:59:48.821544 30230 ts_tablet_manager.cc:1939] T 5e20a55a4d204fedb3c7a1862e8eb5eb P aeccdfe7bb3f4f2a97e7cb7ee66aa51d: Deleting consensus metadata
I20260807 04:59:48.822255 29159 catalog_manager.cc:4841] TS aeccdfe7bb3f4f2a97e7cb7ee66aa51d (127.25.214.195:45523): tablet 5e20a55a4d204fedb3c7a1862e8eb5eb (table test-table [id=15c8c4aa6653460e80062eef6fac54fd]) successfully deleted
I20260807 04:59:48.823442 30228 ts_tablet_manager.cc:1918] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:59:48.823509 30228 log.cc:1196] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/5e20a55a4d204fedb3c7a1862e8eb5eb
I20260807 04:59:48.823704 30228 ts_tablet_manager.cc:1939] T 5e20a55a4d204fedb3c7a1862e8eb5eb P d7adc892caf34167a6e4e83b13ada879: Deleting consensus metadata
I20260807 04:59:48.824313 29164 catalog_manager.cc:4841] TS d7adc892caf34167a6e4e83b13ada879 (127.25.214.194:40365): tablet 5e20a55a4d204fedb3c7a1862e8eb5eb (table test-table [id=15c8c4aa6653460e80062eef6fac54fd]) successfully deleted
W20260807 04:59:48.827754 29159 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:38199 (error 108)
I20260807 04:59:48.827955 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29519
I20260807 04:59:48.837586 30233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:48.836977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:38199 (local address 127.0.0.1:49670)
0807 04:59:48.837293 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:48.837418 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:38199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":81,"threads_started":1}
W20260807 04:59:48.837723 29159 catalog_manager.cc:4584] TS ba9049cf94454db3be9f7682900c5e9d (127.25.214.193:38199): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5e20a55a4d204fedb3c7a1862e8eb5eb: Network error: Client connection negotiation failed: client connection to 127.25.214.193:38199: connect: Connection refused (error 111)
I20260807 04:59:48.843874 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29752
I20260807 04:59:48.855209 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29122
2026-08-07T04:59:48Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6412 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:48 dist-test-slave-lgr5 krb5kdc[30238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:48 dist-test-slave-lgr5 krb5kdc[30238](info): set up 2 sockets
Aug 07 04:59:48 dist-test-slave-lgr5 krb5kdc[30238](info): commencing operation
krb5kdc: starting...
W20260807 04:59:49.998456 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:50.122946 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:35341
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:35341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:50.238148 30256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:50.238415 30256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:50.238454 30256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:50.242288 30256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:50.242333 30256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:50.242350 30256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:50.242364 30256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:50.242378 30256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:50.247416 30256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:35341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:35341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:50.248415 30256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:50.249375 30256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:50.257519 30271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:50.257561 30270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:50.257562 30273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:50.258055 30256 server_base.cc:1034] running on GCE node
I20260807 04:59:50.258603 30256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:50.259677 30256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:50.260851 30256 hybrid_clock.cc:648] HybridClock initialized: now 1786078790260837 us; error 25 us; skew 500 ppm
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:50.267479 30256 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:50.268615 30256 webserver.cc:460] Webserver started at http://127.25.214.254:37537/ using document root <none> and password file <none>
I20260807 04:59:50.269200 30256 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:50.269269 30256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:50.269469 30256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:50.271580 30256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "d7348b08f42348a6b85955f1bf376055"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "d0d5d802f1c4080e2aee8f5e4cb9b7b4"
server_key_iv: "5f5ee8609769704f2fcd0e63b72f10e4"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.272151 30256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "d7348b08f42348a6b85955f1bf376055"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "d0d5d802f1c4080e2aee8f5e4cb9b7b4"
server_key_iv: "5f5ee8609769704f2fcd0e63b72f10e4"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.275676 30256 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:59:50.278128 30286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.279294 30256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:50.279409 30256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "d7348b08f42348a6b85955f1bf376055"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "d0d5d802f1c4080e2aee8f5e4cb9b7b4"
server_key_iv: "5f5ee8609769704f2fcd0e63b72f10e4"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.279505 30256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:50.300169 30256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:50.303449 30256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:50.303648 30256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:50.310535 30256 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:35341
I20260807 04:59:50.310577 30362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:35341 every 8 connection(s)
I20260807 04:59:50.311571 30256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:50.314656 30364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:50.320381 30364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055: Bootstrap starting.
I20260807 04:59:50.320739 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 30256
I20260807 04:59:50.320851 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:50.321135 26459 external_mini_cluster.cc:1428] Setting key fafff228dbee222400c4a57466939d9e
I20260807 04:59:50.323129 30364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:50.323845 30364 log.cc:824] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:50.325683 30364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055: No bootstrap required, opened a new log
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:50.329305 30364 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7348b08f42348a6b85955f1bf376055" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35341 } }
I20260807 04:59:50.329519 30364 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:50.329581 30364 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7348b08f42348a6b85955f1bf376055, State: Initialized, Role: FOLLOWER
I20260807 04:59:50.329995 30364 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7348b08f42348a6b85955f1bf376055" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35341 } }
I20260807 04:59:50.330124 30364 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:50.330190 30364 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:50.330289 30364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:50.331310 30364 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7348b08f42348a6b85955f1bf376055" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35341 } }
I20260807 04:59:50.331758 30364 leader_election.cc:302] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7348b08f42348a6b85955f1bf376055; no voters:
I20260807 04:59:50.332145 30364 leader_election.cc:288] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:50.332231 30372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:50.332446 30372 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [term 1 LEADER]: Becoming Leader. State: Replica: d7348b08f42348a6b85955f1bf376055, State: Running, Role: LEADER
I20260807 04:59:50.332792 30372 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7348b08f42348a6b85955f1bf376055" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35341 } }
I20260807 04:59:50.333626 30364 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:50.334082 30372 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7348b08f42348a6b85955f1bf376055" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7348b08f42348a6b85955f1bf376055" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35341 } } }
I20260807 04:59:50.334206 30372 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:50.334436 30372 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7348b08f42348a6b85955f1bf376055. Latest consensus state: current_term: 1 leader_uuid: "d7348b08f42348a6b85955f1bf376055" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7348b08f42348a6b85955f1bf376055" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35341 } } }
I20260807 04:59:50.334532 30372 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:50.334626 30379 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:50.335636 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:50.322510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40402 (local address 127.25.214.254:35341)
0807 04:59:50.322935 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:50.322951 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:50.322986 (+ 35us) server_negotiation.cc:407] Connection header received
0807 04:59:50.323644 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:50.323662 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:50.323993 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:50.324348 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:50.325151 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.326158 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.327052 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.327520 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.327678 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:50.330019 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:50.330025 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:50.330039 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:50.330068 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:50.331950 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:50.332499 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:50.332506 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:50.332513 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:50.332668 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:50.332967 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:50.332971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:50.332973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:50.333432 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:50.333637 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:50.333943 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 04:59:50.334447 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":114,"threads_started":1}
I20260807 04:59:50.338004 30379 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:50.344830 30379 catalog_manager.cc:1347] Generated new cluster ID: 543eeb2cac4b4e62864f827f978a7ae3
I20260807 04:59:50.344909 30379 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:50.357582 30379 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:50.358592 30379 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:50.364851 30379 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7348b08f42348a6b85955f1bf376055: Generated new TSK 0
I20260807 04:59:50.365551 30379 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:50.399637 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35341
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:50.518054 30402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:50.518370 30402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:50.518432 30402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:50.522619 30402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:50.522698 30402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:50.522780 30402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:50.528347 30402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:50.529493 30402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:50.530599 30402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:50.540366 30408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:50.540378 30412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:50.540375 30410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:50.540769 30402 server_base.cc:1034] running on GCE node
I20260807 04:59:50.541179 30402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:50.541802 30402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:50.542963 30402 hybrid_clock.cc:648] HybridClock initialized: now 1786078790542948 us; error 27 us; skew 500 ppm
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:50.545686 30402 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:50.546658 30402 webserver.cc:460] Webserver started at http://127.25.214.193:33487/ using document root <none> and password file <none>
I20260807 04:59:50.547230 30402 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:50.547302 30402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:50.547518 30402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:50.549655 30402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "883b6b50d4334b1eb7c0124b93930228"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "2445e8366d17666f421e89c484f2db47"
server_key_iv: "0869fc14a1e763aef7fe472347fa26b7"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.550217 30402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "883b6b50d4334b1eb7c0124b93930228"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "2445e8366d17666f421e89c484f2db47"
server_key_iv: "0869fc14a1e763aef7fe472347fa26b7"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.554109 30402 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 04:59:50.556813 30421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.558162 30402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:50.558295 30402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "883b6b50d4334b1eb7c0124b93930228"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "2445e8366d17666f421e89c484f2db47"
server_key_iv: "0869fc14a1e763aef7fe472347fa26b7"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.558413 30402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:50.578162 30402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:50.581511 30402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:50.581696 30402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:50.582331 30402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:50.583200 30402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:50.583249 30402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.583303 30402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:50.583333 30402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.592067 30402 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:35681
I20260807 04:59:50.592121 30594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:35681 every 8 connection(s)
I20260807 04:59:50.593009 30402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:50.597708 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 30402
I20260807 04:59:50.597846 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:50.598131 26459 external_mini_cluster.cc:1428] Setting key 0e6fc21c473d4c456834a3eeaed8f16d
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:50.608479 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:50.594925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46765 (local address 127.25.214.254:35341)
0807 04:59:50.595096 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:50.595100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:50.596000 (+ 900us) server_negotiation.cc:407] Connection header received
0807 04:59:50.597575 (+ 1575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:50.597579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:50.597647 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:50.597750 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:50.599261 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.599914 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.601213 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.601533 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.601654 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:50.604450 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:50.604455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:50.604458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:50.604493 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:50.606073 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:50.606608 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:50.606612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:50.606615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:50.606725 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:50.607062 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:50.607065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:50.607067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:50.607369 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:50.607483 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:50.608053 (+ 570us) server_negotiation.cc:299] Negotiation successful
0807 04:59:50.608244 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 04:59:50.609295 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:50.595305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35341 (local address 127.25.214.193:46765)
0807 04:59:50.595810 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:50.595871 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:50.597306 (+ 1435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:50.597979 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:50.597988 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:50.598429 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:50.599076 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:50.599094 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.600073 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.600097 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:50.601071 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:50.601083 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.601706 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.601709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:50.601880 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:50.602470 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:50.602489 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:50.604240 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:50.606201 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:50.606206 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:50.606221 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:50.606490 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:50.606823 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:50.606825 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:50.606826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:50.606961 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:50.607478 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:50.607483 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:50.607762 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 04:59:50.607933 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 04:59:50.608295 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":121,"threads_started":1}
I20260807 04:59:50.610606 30596 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35341
I20260807 04:59:50.610848 30596 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:50.611366 30596 heartbeater.cc:511] Master 127.25.214.254:35341 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 04:59:50.613108 30308 ts_manager.cc:194] Registered new tserver with Master: 883b6b50d4334b1eb7c0124b93930228 (127.25.214.193:35681)
I20260807 04:59:50.614501 30308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:46765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:50.628535 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35341
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:50.744774 30606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:50.745060 30606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:50.745126 30606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:50.749231 30606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:50.749312 30606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:50.749402 30606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:50.754974 30606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:50.756198 30606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:50.757256 30606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:50.766971 30618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:50.766947 30620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:50.767025 30606 server_base.cc:1034] running on GCE node
W20260807 04:59:50.766949 30613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:50.767678 30606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:50.768342 30606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:50.769495 30606 hybrid_clock.cc:648] HybridClock initialized: now 1786078790769477 us; error 32 us; skew 500 ppm
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:50.772220 30606 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:50.773069 30606 webserver.cc:460] Webserver started at http://127.25.214.194:33533/ using document root <none> and password file <none>
I20260807 04:59:50.773599 30606 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:50.773665 30606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:50.773878 30606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:50.775907 30606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "8c0fe18d04744cc7bff2ec4398f9d202"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "52a0ffefca8a18ca0752fc443b72629d"
server_key_iv: "12448d6b8aca6813afebb82669f1751c"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.776486 30606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "8c0fe18d04744cc7bff2ec4398f9d202"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "52a0ffefca8a18ca0752fc443b72629d"
server_key_iv: "12448d6b8aca6813afebb82669f1751c"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.780238 30606 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:50.782840 30631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.784198 30606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:50.784315 30606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "8c0fe18d04744cc7bff2ec4398f9d202"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "52a0ffefca8a18ca0752fc443b72629d"
server_key_iv: "12448d6b8aca6813afebb82669f1751c"
server_key_version: "encryptionkey@0"
I20260807 04:59:50.784430 30606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:50.808064 30606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:50.811353 30606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:50.811553 30606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:50.812179 30606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:50.813042 30606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:50.813090 30606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.813133 30606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:50.813160 30606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:50.822023 30606 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:38071
I20260807 04:59:50.822077 30801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:38071 every 8 connection(s)
I20260807 04:59:50.822969 30606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:50.825793 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 30606
I20260807 04:59:50.825919 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:50.826248 26459 external_mini_cluster.cc:1428] Setting key 788ad5c5e0a032e02d78d66e115848b7
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 04:59:50.838192 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:50.824844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:39061 (local address 127.25.214.254:35341)
0807 04:59:50.824966 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:50.824970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:50.825891 (+ 921us) server_negotiation.cc:407] Connection header received
0807 04:59:50.827487 (+ 1596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:50.827490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:50.827535 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:50.827595 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:50.829088 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.829803 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.831532 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.831829 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.831945 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:50.834482 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:50.834486 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:50.834489 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:50.834521 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:50.836193 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:50.836699 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:50.836703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:50.836705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:50.836797 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:50.837102 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:50.837106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:50.837108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:50.837357 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:50.837463 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:50.837952 (+ 489us) server_negotiation.cc:299] Negotiation successful
0807 04:59:50.838060 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 04:59:50.839037 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:50.825220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35341 (local address 127.25.214.194:39061)
0807 04:59:50.825725 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:50.825785 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:50.827229 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:50.827810 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:50.827820 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:50.828416 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:50.828946 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:50.828960 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.829990 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.829995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:50.831417 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:50.831430 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:50.831975 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:50.831977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:50.832169 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:50.832736 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:50.832753 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:50.834254 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:50.836304 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:50.836309 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:50.836322 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:50.836593 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:50.836889 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:50.836892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:50.836893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:50.837016 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:50.837461 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:50.837466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:50.837737 (+ 271us) client_negotiation.cc:769] Sending connection context
0807 04:59:50.837901 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 04:59:50.838176 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 04:59:50.840226 30802 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35341
I20260807 04:59:50.840473 30802 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:50.840986 30802 heartbeater.cc:511] Master 127.25.214.254:35341 requested a full tablet report, sending...
I20260807 04:59:50.842123 30308 ts_manager.cc:194] Registered new tserver with Master: 8c0fe18d04744cc7bff2ec4398f9d202 (127.25.214.194:38071)
I20260807 04:59:50.842850 30308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:39061
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:50.855100 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35341
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:50.972205 30807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:50.972491 30807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:50.972534 30807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:50.976595 30807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:50.976665 30807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:50.976725 30807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:50.982318 30807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:50.983534 30807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:50.984678 30807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:50.995409 30819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:50.995435 30817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:50.995736 30807 server_base.cc:1034] running on GCE node
W20260807 04:59:50.995405 30815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:50.996368 30807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:50.997032 30807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:50.998188 30807 hybrid_clock.cc:648] HybridClock initialized: now 1786078790998169 us; error 30 us; skew 500 ppm
Aug 07 04:59:50 dist-test-slave-lgr5 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:51.000980 30807 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:51.002004 30807 webserver.cc:460] Webserver started at http://127.25.214.195:45847/ using document root <none> and password file <none>
I20260807 04:59:51.002573 30807 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:51.002635 30807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:51.002816 30807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:51.005007 30807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "f7eab2e4071f4bee81cd619b1ff29c2b"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "5b149486c1b5344d2907d9ca3d6833a6"
server_key_iv: "bdfb90195dec640865589a8e946d6e89"
server_key_version: "encryptionkey@0"
I20260807 04:59:51.005556 30807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "f7eab2e4071f4bee81cd619b1ff29c2b"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "5b149486c1b5344d2907d9ca3d6833a6"
server_key_iv: "bdfb90195dec640865589a8e946d6e89"
server_key_version: "encryptionkey@0"
I20260807 04:59:51.009438 30807 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:51.011940 30833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:51.013223 30807 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:51.013330 30807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "f7eab2e4071f4bee81cd619b1ff29c2b"
format_stamp: "Formatted at 2026-08-07 04:59:50 on dist-test-slave-lgr5"
server_key: "5b149486c1b5344d2907d9ca3d6833a6"
server_key_iv: "bdfb90195dec640865589a8e946d6e89"
server_key_version: "encryptionkey@0"
I20260807 04:59:51.013433 30807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:51.038437 30807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:51.041968 30807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:51.042158 30807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:51.042804 30807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:51.043663 30807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:51.043709 30807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:51.043764 30807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:51.043793 30807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:51.052860 30807 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:41757
I20260807 04:59:51.052901 31002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:41757 every 8 connection(s)
I20260807 04:59:51.053845 30807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 04:59:51.062902 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 30807
I20260807 04:59:51.063030 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:51.063313 26459 external_mini_cluster.cc:1428] Setting key 713ebeaceb9f1e67032df3e01742198c
Aug 07 04:59:51 dist-test-slave-lgr5 krb5kdc[30238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:51.067428 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:51.055774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:53259 (local address 127.25.214.254:35341)
0807 04:59:51.055928 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:51.055932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:51.056906 (+ 974us) server_negotiation.cc:407] Connection header received
0807 04:59:51.058209 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:51.058213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:51.058273 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:51.058348 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:51.059549 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:51.060117 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:51.061249 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:51.061483 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:51.061570 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:51.064102 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:51.064106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:51.064109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:51.064138 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:51.065661 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:51.066146 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:51.066148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:51.066149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:51.066222 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:51.066500 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:51.066502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:51.066503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:51.066673 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:51.066746 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:51.067196 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 04:59:51.067299 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 04:59:51.068364 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:51.056221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35341 (local address 127.25.214.195:53259)
0807 04:59:51.056735 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:51.056782 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:51.057993 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:51.058524 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:51.058531 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:51.058912 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:51.059410 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:51.059425 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:51.060246 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:51.060248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:51.061131 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:51.061141 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:51.061626 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:51.061630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:51.061790 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:51.062314 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:51.062335 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:51.063902 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:51.065768 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:51.065773 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:51.065786 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:51.066067 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:51.066285 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:51.066287 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:51.066288 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:51.066433 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:51.066745 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:51.066750 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:51.067011 (+ 261us) client_negotiation.cc:769] Sending connection context
0807 04:59:51.067168 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 04:59:51.067453 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":127,"threads_started":1}
I20260807 04:59:51.069496 31003 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35341
I20260807 04:59:51.069722 31003 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:51.070221 31003 heartbeater.cc:511] Master 127.25.214.254:35341 requested a full tablet report, sending...
I20260807 04:59:51.071290 30308 ts_manager.cc:194] Registered new tserver with Master: f7eab2e4071f4bee81cd619b1ff29c2b (127.25.214.195:41757)
I20260807 04:59:51.071879 30308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:53259
I20260807 04:59:51.077387 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 04:59:51.092693 30370 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:59:51.091087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.25.214.254:35341)
0807 04:59:51.091247 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:51.091252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:51.091423 (+ 171us) server_negotiation.cc:407] Connection header received
0807 04:59:51.091565 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:51.091569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:51.091619 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:51.091689 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:51.092542 (+ 853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40418: BlockingRecv error: recv got EOF from 127.0.0.1:40418 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:59:51.093912 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 30402
I20260807 04:59:51.108214 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 30606
I20260807 04:59:51.125341 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 30807
I20260807 04:59:51.140938 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 30256
2026-08-07T04:59:51Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2284 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:51 dist-test-slave-lgr5 krb5kdc[31024](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:51 dist-test-slave-lgr5 krb5kdc[31024](info): set up 2 sockets
Aug 07 04:59:51 dist-test-slave-lgr5 krb5kdc[31024](info): commencing operation
krb5kdc: starting...
W20260807 04:59:52.286306 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:52 dist-test-slave-lgr5 krb5kdc[31024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:52.412065 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36811
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:32807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:52.524528 31052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:52.524823 31052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:52.524880 31052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:52.528925 31052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:52.528987 31052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:52.529013 31052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:52.529035 31052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:52.529064 31052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:52.534472 31052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:32807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:52.535669 31052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:52.536767 31052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:52.544881 31060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:52.544881 31066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:52.544929 31052 server_base.cc:1034] running on GCE node
W20260807 04:59:52.544914 31061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:52.545661 31052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:52.546698 31052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:52.547881 31052 hybrid_clock.cc:648] HybridClock initialized: now 1786078792547859 us; error 29 us; skew 500 ppm
Aug 07 04:59:52 dist-test-slave-lgr5 krb5kdc[31024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078792, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:52.550994 31052 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:52.551885 31052 webserver.cc:460] Webserver started at http://127.25.214.254:44915/ using document root <none> and password file <none>
I20260807 04:59:52.552459 31052 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:52.552520 31052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:52.552685 31052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:52.554700 31052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "10417b36f1f9484b8ad659e2f1392377"
format_stamp: "Formatted at 2026-08-07 04:59:52 on dist-test-slave-lgr5"
server_key: "b666ecc3beb3f6e1ebf6c07faff6f711"
server_key_iv: "7f5aa4b66df4345eb6c0f730ab02f350"
server_key_version: "encryptionkey@0"
I20260807 04:59:52.555239 31052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "10417b36f1f9484b8ad659e2f1392377"
format_stamp: "Formatted at 2026-08-07 04:59:52 on dist-test-slave-lgr5"
server_key: "b666ecc3beb3f6e1ebf6c07faff6f711"
server_key_iv: "7f5aa4b66df4345eb6c0f730ab02f350"
server_key_version: "encryptionkey@0"
I20260807 04:59:52.558888 31052 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 04:59:52.561295 31075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:52.562549 31052 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 04:59:52.562661 31052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "10417b36f1f9484b8ad659e2f1392377"
format_stamp: "Formatted at 2026-08-07 04:59:52 on dist-test-slave-lgr5"
server_key: "b666ecc3beb3f6e1ebf6c07faff6f711"
server_key_iv: "7f5aa4b66df4345eb6c0f730ab02f350"
server_key_version: "encryptionkey@0"
I20260807 04:59:52.562762 31052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:52.585703 31052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:52.588897 31052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:52.589098 31052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:52.596287 31052 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:36811
I20260807 04:59:52.596565 31156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:36811 every 8 connection(s)
I20260807 04:59:52.597317 31052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:52.598893 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 31052
I20260807 04:59:52.599014 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:52.599291 26459 external_mini_cluster.cc:1428] Setting key 9c4cc6e99499dccbc1dcea5585dcdd3b
I20260807 04:59:52.600529 31157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:52.607972 31157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377: Bootstrap starting.
Aug 07 04:59:52 dist-test-slave-lgr5 krb5kdc[31024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:52.610821 31157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:52.611763 31157 log.cc:824] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:52.613868 31157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377: No bootstrap required, opened a new log
I20260807 04:59:52.614827 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:52.600734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.25.214.254:36811)
0807 04:59:52.601206 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:52.601228 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:52.601275 (+ 47us) server_negotiation.cc:407] Connection header received
0807 04:59:52.602176 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:52.602201 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:52.602655 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:52.603084 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:52.603833 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:52.605376 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:52.606270 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:52.607001 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:52.607179 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:52.609891 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:52.609898 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:52.609913 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:52.609949 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:52.611834 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:52.612372 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:52.612378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:52.612382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:52.612505 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:52.612772 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:52.612775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:52.612777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:52.613204 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:52.613418 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:52.613699 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 04:59:52.614044 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":122,"threads_started":1}
I20260807 04:59:52.617153 31157 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10417b36f1f9484b8ad659e2f1392377" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36811 } }
I20260807 04:59:52.617465 31157 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:52.617544 31157 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10417b36f1f9484b8ad659e2f1392377, State: Initialized, Role: FOLLOWER
I20260807 04:59:52.618026 31157 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10417b36f1f9484b8ad659e2f1392377" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36811 } }
I20260807 04:59:52.618181 31157 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:52.618249 31157 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:52.618391 31157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:52.618474 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:59:52.619405 31157 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10417b36f1f9484b8ad659e2f1392377" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36811 } }
I20260807 04:59:52.619755 31157 leader_election.cc:302] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10417b36f1f9484b8ad659e2f1392377; no voters:
I20260807 04:59:52.620071 31157 leader_election.cc:288] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:52.620213 31163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:52.620399 31163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [term 1 LEADER]: Becoming Leader. State: Replica: 10417b36f1f9484b8ad659e2f1392377, State: Running, Role: LEADER
I20260807 04:59:52.620777 31163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10417b36f1f9484b8ad659e2f1392377" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36811 } }
I20260807 04:59:52.621500 31157 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:52.622026 31163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10417b36f1f9484b8ad659e2f1392377. Latest consensus state: current_term: 1 leader_uuid: "10417b36f1f9484b8ad659e2f1392377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10417b36f1f9484b8ad659e2f1392377" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36811 } } }
I20260807 04:59:52.622239 31163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:52.622450 31165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10417b36f1f9484b8ad659e2f1392377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10417b36f1f9484b8ad659e2f1392377" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36811 } } }
I20260807 04:59:52.622593 31165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:52.622754 31176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:52.626140 31176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:52.632515 31176 catalog_manager.cc:1347] Generated new cluster ID: c09ff9b387a341ebb828f85623d12dfb
I20260807 04:59:52.632660 31176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:52.640791 31176 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:52.641626 31176 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:52.645258 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:52.636278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51834 (local address 127.25.214.254:36811)
0807 04:59:52.636407 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:52.636412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:52.636672 (+ 260us) server_negotiation.cc:407] Connection header received
0807 04:59:52.636796 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:52.636799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:52.636860 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:52.636962 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:52.637493 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:52.638292 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:52.639396 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:52.639748 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:52.639856 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:52.644241 (+ 4385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:52.644245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:52.644248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:59:52.644791 (+ 543us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:52.644828 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:59:52.644858 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:52.644941 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:52.645033 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 04:59:52.645114 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 04:59:52.653374 31176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10417b36f1f9484b8ad659e2f1392377: Generated new TSK 0
I20260807 04:59:52.653999 31176 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:59:52.660799 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 31052
2026-08-07T04:59:52Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1522 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:52 dist-test-slave-lgr5 krb5kdc[31207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:52 dist-test-slave-lgr5 krb5kdc[31207](info): set up 2 sockets
Aug 07 04:59:52 dist-test-slave-lgr5 krb5kdc[31207](info): commencing operation
krb5kdc: starting...
W20260807 04:59:53.839799 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:53 dist-test-slave-lgr5 krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:53.962735 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:46807
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:46807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:54.079119 31226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:54.079411 31226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:54.079468 31226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:54.083479 31226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:54.083549 31226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:54.083575 31226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:54.083596 31226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:54.083626 31226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:54.089020 31226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:46807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:46807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:54.090116 31226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:54.091153 31226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:54.099473 31238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.099515 31233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.099510 31234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:54.099835 31226 server_base.cc:1034] running on GCE node
I20260807 04:59:54.100435 31226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:54.101544 31226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:54.102720 31226 hybrid_clock.cc:648] HybridClock initialized: now 1786078794102705 us; error 30 us; skew 500 ppm
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:54.105548 31226 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:54.106431 31226 webserver.cc:460] Webserver started at http://127.25.214.254:44517/ using document root <none> and password file <none>
I20260807 04:59:54.106943 31226 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:54.107000 31226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:54.107162 31226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:54.109216 31226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "276f7cdd035044b4af48861310fa441e"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "33820a5308907d277a38767133571390"
server_key_iv: "642a96f50bf46ca3e3935b416e796bca"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.109738 31226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "276f7cdd035044b4af48861310fa441e"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "33820a5308907d277a38767133571390"
server_key_iv: "642a96f50bf46ca3e3935b416e796bca"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.113396 31226 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:59:54.115772 31248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.117038 31226 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:54.117159 31226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "276f7cdd035044b4af48861310fa441e"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "33820a5308907d277a38767133571390"
server_key_iv: "642a96f50bf46ca3e3935b416e796bca"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.117255 31226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:54.126976 31226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:54.130016 31226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:54.130192 31226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:54.137279 31226 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:46807
I20260807 04:59:54.137595 31335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:46807 every 8 connection(s)
I20260807 04:59:54.138242 31226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:54.138870 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 31226
I20260807 04:59:54.139014 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:54.139321 26459 external_mini_cluster.cc:1428] Setting key 19a8207922ba570d50125c5b197d39ba
I20260807 04:59:54.141424 31336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:54.147876 31336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e: Bootstrap starting.
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:54.150396 31336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:54.151237 31336 log.cc:824] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:54.153442 31336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e: No bootstrap required, opened a new log
I20260807 04:59:54.153847 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.140761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38520 (local address 127.25.214.254:46807)
0807 04:59:54.141204 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:54.141223 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:54.141265 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:59:54.142102 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:54.142126 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:54.142532 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:54.142880 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:54.143581 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.145066 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.145925 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.146621 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.146788 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.149078 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:54.149085 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:54.149100 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:54.149131 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:54.150935 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.151323 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.151328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.151334 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.151476 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.151753 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.151756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.151757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.152224 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:54.152405 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:54.152658 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 04:59:54.152937 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":123,"threads_started":1}
I20260807 04:59:54.157379 31336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276f7cdd035044b4af48861310fa441e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46807 } }
I20260807 04:59:54.157609 31336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:54.157653 31336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276f7cdd035044b4af48861310fa441e, State: Initialized, Role: FOLLOWER
I20260807 04:59:54.158048 31336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276f7cdd035044b4af48861310fa441e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46807 } }
I20260807 04:59:54.158174 31336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:54.158221 31336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:54.158293 31336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:54.159155 31336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276f7cdd035044b4af48861310fa441e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46807 } }
I20260807 04:59:54.159451 31336 leader_election.cc:302] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 276f7cdd035044b4af48861310fa441e; no voters:
I20260807 04:59:54.159699 31336 leader_election.cc:288] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:54.159830 31342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:54.160044 31342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [term 1 LEADER]: Becoming Leader. State: Replica: 276f7cdd035044b4af48861310fa441e, State: Running, Role: LEADER
I20260807 04:59:54.160398 31342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276f7cdd035044b4af48861310fa441e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46807 } }
I20260807 04:59:54.160878 31336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:54.162017 31344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 276f7cdd035044b4af48861310fa441e. Latest consensus state: current_term: 1 leader_uuid: "276f7cdd035044b4af48861310fa441e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276f7cdd035044b4af48861310fa441e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46807 } } }
I20260807 04:59:54.162145 31344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:54.162405 31343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "276f7cdd035044b4af48861310fa441e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276f7cdd035044b4af48861310fa441e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46807 } } }
I20260807 04:59:54.162506 31343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e [sys.catalog]: This master's current role is: LEADER
W20260807 04:59:54.165261 31366 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:59:54.165328 31366 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:59:54.165426 31355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:54.166106 31355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:54.171397 31355 catalog_manager.cc:1347] Generated new cluster ID: 776200c147dc460d8a569e6131b350de
I20260807 04:59:54.171460 31355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:54.178470 31355 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:54.179714 31355 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:54.189981 31355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 276f7cdd035044b4af48861310fa441e: Generated new TSK 0
I20260807 04:59:54.190629 31355 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:54.220868 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46807
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:54.330713 31374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:54.330981 31374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:54.331025 31374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:54.334980 31374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:54.335033 31374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:54.335112 31374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:54.340389 31374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:54.341487 31374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:54.342510 31374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:54.351887 31383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.351893 31390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:54.351996 31374 server_base.cc:1034] running on GCE node
W20260807 04:59:54.351866 31381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:54.352557 31374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:54.353163 31374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:54.354322 31374 hybrid_clock.cc:648] HybridClock initialized: now 1786078794354305 us; error 30 us; skew 500 ppm
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:54.356889 31374 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:54.357672 31374 webserver.cc:460] Webserver started at http://127.25.214.193:42539/ using document root <none> and password file <none>
I20260807 04:59:54.358197 31374 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:54.358263 31374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:54.358469 31374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:54.360517 31374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "ebefa805d55e4c8ca473ba772960feac"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "ac76bd0c92e66e71447f4165e65c437e"
server_key_iv: "06e9beba74f73643f200c6d94c8f7877"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.361079 31374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "ebefa805d55e4c8ca473ba772960feac"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "ac76bd0c92e66e71447f4165e65c437e"
server_key_iv: "06e9beba74f73643f200c6d94c8f7877"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.365232 31374 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 04:59:54.367676 31403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.368882 31374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 04:59:54.369000 31374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "ebefa805d55e4c8ca473ba772960feac"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "ac76bd0c92e66e71447f4165e65c437e"
server_key_iv: "06e9beba74f73643f200c6d94c8f7877"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.369105 31374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:54.386224 31374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:54.389395 31374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:54.389593 31374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:54.390221 31374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:54.391121 31374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:54.391175 31374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.391237 31374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:54.391269 31374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.401053 31374 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:38185
I20260807 04:59:54.401072 31592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:38185 every 8 connection(s)
I20260807 04:59:54.402007 31374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:54.407068 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 31374
I20260807 04:59:54.407202 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:54.407570 26459 external_mini_cluster.cc:1428] Setting key 865c9726b8cc445b6e556b4fcc766954
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:54.415856 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.403750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:34227 (local address 127.25.214.254:46807)
0807 04:59:54.403954 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:54.403959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:54.404820 (+ 861us) server_negotiation.cc:407] Connection header received
0807 04:59:54.406102 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:54.406104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:54.406156 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:54.406239 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:54.407409 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.408165 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.409279 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.409612 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.409720 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.412186 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:54.412191 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:54.412194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:54.412223 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:54.413668 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.414195 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.414200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.414201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.414285 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.414641 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.414645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.414647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.414864 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:54.414963 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:54.415514 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 04:59:54.415659 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 04:59:54.416704 31596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.404201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:46807 (local address 127.25.214.193:34227)
0807 04:59:54.404657 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:54.404702 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:54.405900 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:54.406387 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:54.406393 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:54.406733 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:54.407250 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:54.407268 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.408282 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.408285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:54.409159 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:54.409168 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.409744 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.409747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:54.409892 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.410471 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:54.410487 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:54.411996 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:54.413783 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:54.413789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:54.413806 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:54.414088 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:54.414378 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:54.414381 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:54.414384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:54.414542 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:54.414976 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:54.414983 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:54.415257 (+ 274us) client_negotiation.cc:769] Sending connection context
0807 04:59:54.415452 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 04:59:54.415795 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":127,"threads_started":1}
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 04:59:54.417963 31593 heartbeater.cc:347] Connected to a master server at 127.25.214.254:46807
I20260807 04:59:54.418191 31593 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:54.418675 31593 heartbeater.cc:511] Master 127.25.214.254:46807 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 04:59:54.420382 31276 ts_manager.cc:194] Registered new tserver with Master: ebefa805d55e4c8ca473ba772960feac (127.25.214.193:38185)
I20260807 04:59:54.421634 31276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:34227
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:54.435618 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46807
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:54.544567 31602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:54.544843 31602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:54.544884 31602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:54.549000 31602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:54.549065 31602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:54.549125 31602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:54.554426 31602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:54.555459 31602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:54.556488 31602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:54.565908 31608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.565903 31611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.565900 31609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:54.565958 31602 server_base.cc:1034] running on GCE node
I20260807 04:59:54.566550 31602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:54.567195 31602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:54.568377 31602 hybrid_clock.cc:648] HybridClock initialized: now 1786078794568357 us; error 34 us; skew 500 ppm
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:54.571151 31602 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:54.572242 31602 webserver.cc:460] Webserver started at http://127.25.214.194:45109/ using document root <none> and password file <none>
I20260807 04:59:54.572820 31602 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:54.572894 31602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:54.573141 31602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:54.575301 31602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "066f8cdf8d954260b5159015f7db7c76"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "fefedb6c43e35dc7d43d9130906f794a"
server_key_iv: "19d94e8117abc3b934aa6e07961322d5"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.575870 31602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "066f8cdf8d954260b5159015f7db7c76"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "fefedb6c43e35dc7d43d9130906f794a"
server_key_iv: "19d94e8117abc3b934aa6e07961322d5"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.579618 31602 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:59:54.581976 31622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.583130 31602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:54.583240 31602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "066f8cdf8d954260b5159015f7db7c76"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "fefedb6c43e35dc7d43d9130906f794a"
server_key_iv: "19d94e8117abc3b934aa6e07961322d5"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.583329 31602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:54.603386 31602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:54.606523 31602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:54.606705 31602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:54.607290 31602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:54.608143 31602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:54.608191 31602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.608245 31602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:54.608271 31602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.616997 31602 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:36705
I20260807 04:59:54.617035 31801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:36705 every 8 connection(s)
I20260807 04:59:54.617883 31602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:54.622403 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 31602
I20260807 04:59:54.622545 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:54.622905 26459 external_mini_cluster.cc:1428] Setting key d4d4f14669c977edfe17bb1aba455360
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:54.632232 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.619727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:44315 (local address 127.25.214.254:46807)
0807 04:59:54.619876 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:54.619880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:54.620749 (+ 869us) server_negotiation.cc:407] Connection header received
0807 04:59:54.622140 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:54.622143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:54.622192 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:54.622262 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:54.623695 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.624294 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.625463 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.625752 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.625855 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.628597 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:54.628601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:54.628603 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:54.628626 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:54.630004 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.630614 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.630616 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.630617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.630683 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.631070 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.631072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.631073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.631227 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:54.631295 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:54.631957 (+ 662us) server_negotiation.cc:299] Negotiation successful
0807 04:59:54.632062 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 04:59:54.633461 31804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.620105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:46807 (local address 127.25.214.194:44315)
0807 04:59:54.620606 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:54.620651 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:54.621945 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:54.622446 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:54.622455 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:54.622960 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:54.623544 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:54.623560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.624416 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.624420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:54.625333 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:54.625343 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.625913 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.625917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:54.626070 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.626689 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:54.626712 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:54.628428 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:54.630128 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:54.630135 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:54.630150 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:54.630507 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:54.630764 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:54.630767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:54.630769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:54.630970 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:54.631323 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:54.631330 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:54.631653 (+ 323us) client_negotiation.cc:769] Sending connection context
0807 04:59:54.631893 (+ 240us) client_negotiation.cc:240] Negotiation successful
0807 04:59:54.632302 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":129,"threads_started":1}
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 04:59:54.634586 31802 heartbeater.cc:347] Connected to a master server at 127.25.214.254:46807
I20260807 04:59:54.634819 31802 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:54.635344 31802 heartbeater.cc:511] Master 127.25.214.254:46807 requested a full tablet report, sending...
I20260807 04:59:54.636368 31276 ts_manager.cc:194] Registered new tserver with Master: 066f8cdf8d954260b5159015f7db7c76 (127.25.214.194:36705)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 04:59:54.636945 31276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:44315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:54.651002 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46807
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:54.766440 31810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:54.766736 31810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:54.766809 31810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:54.770944 31810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:54.771027 31810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:54.771121 31810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:54.776705 31810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:54.777812 31810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:54.778937 31810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:54.788651 31821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.788643 31817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:54.788643 31823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:54.789011 31810 server_base.cc:1034] running on GCE node
I20260807 04:59:54.789433 31810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:54.790093 31810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:54.791250 31810 hybrid_clock.cc:648] HybridClock initialized: now 1786078794791235 us; error 34 us; skew 500 ppm
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:54.793881 31810 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:54.794699 31810 webserver.cc:460] Webserver started at http://127.25.214.195:34835/ using document root <none> and password file <none>
I20260807 04:59:54.795255 31810 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:54.795323 31810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:54.795508 31810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:54.797647 31810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "b4052f0d82b34715ba0c005f04b2e90f"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "c6c6e0fae6e784ed6675b99671559d82"
server_key_iv: "a165206d896c1a93ba40deab5d460bd4"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.798188 31810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "b4052f0d82b34715ba0c005f04b2e90f"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "c6c6e0fae6e784ed6675b99671559d82"
server_key_iv: "a165206d896c1a93ba40deab5d460bd4"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.801795 31810 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 04:59:54.804147 31832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.805361 31810 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:54.805471 31810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "b4052f0d82b34715ba0c005f04b2e90f"
format_stamp: "Formatted at 2026-08-07 04:59:54 on dist-test-slave-lgr5"
server_key: "c6c6e0fae6e784ed6675b99671559d82"
server_key_iv: "a165206d896c1a93ba40deab5d460bd4"
server_key_version: "encryptionkey@0"
I20260807 04:59:54.805564 31810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:54.818025 31810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:54.820708 31810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:54.820899 31810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:54.821446 31810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:54.822249 31810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:54.822297 31810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.822348 31810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:54.822378 31810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:54.830951 31810 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:44259
I20260807 04:59:54.830987 31994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:44259 every 8 connection(s)
I20260807 04:59:54.831784 31810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 04:59:54.837589 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 31810
I20260807 04:59:54.837711 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:54.837997 26459 external_mini_cluster.cc:1428] Setting key ececcad0cccdaec74c5f93bc5b7fb7a8
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:54.844487 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.833478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:50637 (local address 127.25.214.254:46807)
0807 04:59:54.833644 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:54.833649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:54.834432 (+ 783us) server_negotiation.cc:407] Connection header received
0807 04:59:54.835744 (+ 1312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:54.835747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:54.835795 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:54.835872 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:54.836958 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.837608 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.838778 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.839069 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.839168 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.841503 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:54.841506 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:54.841508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:54.841531 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:54.842811 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.843242 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.843244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.843245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.843313 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.843563 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.843565 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.843566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.843724 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:54.843793 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:54.844249 (+ 456us) server_negotiation.cc:299] Negotiation successful
0807 04:59:54.844345 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:59:54.845270 31997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.833842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:46807 (local address 127.25.214.195:50637)
0807 04:59:54.834281 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:54.834322 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:54.835524 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:54.836012 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:54.836018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:54.836373 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:54.836840 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:54.836852 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.837756 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.837760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:54.838669 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:54.838680 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.839213 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.839216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:54.839358 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.839937 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:54.839961 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:54.841345 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:54.842912 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:54.842917 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:54.842928 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:54.843169 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:54.843374 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:54.843376 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:54.843378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:54.843499 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:54.843793 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:54.843797 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:54.844019 (+ 222us) client_negotiation.cc:769] Sending connection context
0807 04:59:54.844206 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 04:59:54.844448 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":121,"threads_started":1}
I20260807 04:59:54.846261 31995 heartbeater.cc:347] Connected to a master server at 127.25.214.254:46807
I20260807 04:59:54.846469 31995 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:54.846895 31995 heartbeater.cc:511] Master 127.25.214.254:46807 requested a full tablet report, sending...
I20260807 04:59:54.847862 31276 ts_manager.cc:194] Registered new tserver with Master: b4052f0d82b34715ba0c005f04b2e90f (127.25.214.195:44259)
I20260807 04:59:54.848456 31276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:50637
I20260807 04:59:54.851441 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078794, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:54.877426 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:54.869534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38534 (local address 127.25.214.254:46807)
0807 04:59:54.869685 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:54.869690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:54.869840 (+ 150us) server_negotiation.cc:407] Connection header received
0807 04:59:54.869990 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:54.869992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:54.870036 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:54.870105 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:54.870812 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.871347 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.872198 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:54.872411 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:54.872501 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:54.874707 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:54.874710 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:54.874712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:54.874741 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:54.875845 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.876281 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.876284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.876285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.876359 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:54.876607 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:54.876611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:54.876613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:54.876823 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:54.876942 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:54.877169 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 04:59:54.877278 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 04:59:54.877801 31276 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38534
I20260807 04:59:54.878655 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 31374
I20260807 04:59:54.897162 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 31602
I20260807 04:59:54.908448 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 31810
I20260807 04:59:54.917371 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 31226
2026-08-07T04:59:54Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2250 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[32011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[32011](info): set up 2 sockets
Aug 07 04:59:54 dist-test-slave-lgr5 krb5kdc[32011](info): commencing operation
krb5kdc: starting...
W20260807 04:59:56.070472 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 04:59:56.199422 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36337
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:56.313886 32029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:56.314205 32029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:56.314252 32029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:56.318372 32029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:56.318441 32029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:56.318460 32029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:56.318475 32029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:56.318495 32029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:56.323870 32029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:56.324967 32029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:56.325971 32029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:56.334213 32038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:56.334196 32040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:56.334197 32044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:56.334527 32029 server_base.cc:1034] running on GCE node
I20260807 04:59:56.335098 32029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:56.336227 32029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:56.337419 32029 hybrid_clock.cc:648] HybridClock initialized: now 1786078796337411 us; error 34 us; skew 500 ppm
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:56.344350 32029 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:56.345342 32029 webserver.cc:460] Webserver started at http://127.25.214.254:45461/ using document root <none> and password file <none>
I20260807 04:59:56.345914 32029 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:56.345985 32029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:56.346194 32029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:56.348632 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "9919ee2a10a247c9821b052bc8850d9d"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "d5396b9625c154aca1dd5141c5002193"
server_key_iv: "fb93d8c30899a8d0004dd61f30ee34bc"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.349249 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "9919ee2a10a247c9821b052bc8850d9d"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "d5396b9625c154aca1dd5141c5002193"
server_key_iv: "fb93d8c30899a8d0004dd61f30ee34bc"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.353247 32029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:56.355747 32054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.356990 32029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:56.357112 32029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "9919ee2a10a247c9821b052bc8850d9d"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "d5396b9625c154aca1dd5141c5002193"
server_key_iv: "fb93d8c30899a8d0004dd61f30ee34bc"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.357213 32029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:56.374061 32029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:56.377334 32029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:56.377532 32029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:56.384420 32029 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:36337
I20260807 04:59:56.384449 32132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:36337 every 8 connection(s)
I20260807 04:59:56.385349 32029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:56.386360 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 32029
I20260807 04:59:56.386540 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:56.386875 26459 external_mini_cluster.cc:1428] Setting key ff1341bc0feb7e868bf77b6bef2a0bb9
I20260807 04:59:56.388717 32133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:56.394521 32133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d: Bootstrap starting.
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:56.397294 32133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:56.398218 32133 log.cc:824] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:59:56.400647 32133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d: No bootstrap required, opened a new log
I20260807 04:59:56.401335 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:56.388465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33332 (local address 127.25.214.254:36337)
0807 04:59:56.388942 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:56.388958 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:56.388996 (+ 38us) server_negotiation.cc:407] Connection header received
0807 04:59:56.389649 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:56.389666 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:56.389985 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:56.390295 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:56.391110 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.392164 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.392986 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.393454 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.393597 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:56.396273 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:56.396280 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:56.396297 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:56.396333 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:56.398175 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:56.398627 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:56.398633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:56.398639 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:56.398763 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:56.399057 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:56.399059 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:56.399061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:56.399556 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:56.399751 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:56.399975 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 04:59:56.400309 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":146,"threads_started":1}
I20260807 04:59:56.404295 32133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9919ee2a10a247c9821b052bc8850d9d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36337 } }
I20260807 04:59:56.404526 32133 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:56.404572 32133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9919ee2a10a247c9821b052bc8850d9d, State: Initialized, Role: FOLLOWER
I20260807 04:59:56.404932 32133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9919ee2a10a247c9821b052bc8850d9d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36337 } }
I20260807 04:59:56.405045 32133 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:56.405086 32133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:56.405155 32133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:56.406016 32133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9919ee2a10a247c9821b052bc8850d9d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36337 } }
I20260807 04:59:56.406311 32133 leader_election.cc:302] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9919ee2a10a247c9821b052bc8850d9d; no voters:
I20260807 04:59:56.406574 32133 leader_election.cc:288] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:56.406714 32139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:56.406963 32139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [term 1 LEADER]: Becoming Leader. State: Replica: 9919ee2a10a247c9821b052bc8850d9d, State: Running, Role: LEADER
I20260807 04:59:56.407258 32139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9919ee2a10a247c9821b052bc8850d9d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36337 } }
I20260807 04:59:56.407747 32133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:56.408928 32140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9919ee2a10a247c9821b052bc8850d9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9919ee2a10a247c9821b052bc8850d9d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36337 } } }
I20260807 04:59:56.409058 32140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:56.409415 32141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9919ee2a10a247c9821b052bc8850d9d. Latest consensus state: current_term: 1 leader_uuid: "9919ee2a10a247c9821b052bc8850d9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9919ee2a10a247c9821b052bc8850d9d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36337 } } }
I20260807 04:59:56.409476 32150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:56.409504 32141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:56.412600 32150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:56.418358 32150 catalog_manager.cc:1347] Generated new cluster ID: 748db6b4bf894dd2a8df611213824f68
I20260807 04:59:56.418422 32150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:56.434062 32150 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:56.435057 32150 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:56.439584 32150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9919ee2a10a247c9821b052bc8850d9d: Generated new TSK 0
I20260807 04:59:56.440359 32150 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 04:59:56.479388 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36337
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:56.612736 32165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:56.613039 32165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:56.613082 32165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:56.617183 32165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:56.617242 32165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:56.617305 32165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 04:59:56.622556 32165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:56.623603 32165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:56.624658 32165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:56.634151 32175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:56.634126 32172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:56.634246 32165 server_base.cc:1034] running on GCE node
W20260807 04:59:56.634155 32179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:56.634809 32165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:56.635425 32165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:56.636579 32165 hybrid_clock.cc:648] HybridClock initialized: now 1786078796636566 us; error 30 us; skew 500 ppm
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:56.639194 32165 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 04:59:56.640061 32165 webserver.cc:460] Webserver started at http://127.25.214.193:40865/ using document root <none> and password file <none>
I20260807 04:59:56.640617 32165 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:56.640687 32165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:56.640874 32165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:56.642853 32165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "eb5c92656170413f9aa1bc2ba034f65d"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "ce7a9b0d645976b360fa1b0b5bceff8b"
server_key_iv: "361853674ab8a99d6e141515d2b591ab"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.643383 32165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "eb5c92656170413f9aa1bc2ba034f65d"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "ce7a9b0d645976b360fa1b0b5bceff8b"
server_key_iv: "361853674ab8a99d6e141515d2b591ab"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.646976 32165 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 04:59:56.649413 32187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.650560 32165 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 04:59:56.650681 32165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "eb5c92656170413f9aa1bc2ba034f65d"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "ce7a9b0d645976b360fa1b0b5bceff8b"
server_key_iv: "361853674ab8a99d6e141515d2b591ab"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.650779 32165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:56.671772 32165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:56.675004 32165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:56.675202 32165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:56.675797 32165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:56.676680 32165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:56.676729 32165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.676783 32165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:56.676810 32165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.685597 32165 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:39447
I20260807 04:59:56.685642 32355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:39447 every 8 connection(s)
I20260807 04:59:56.686558 32165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 04:59:56.687294 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 32165
I20260807 04:59:56.687412 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 04:59:56.687700 26459 external_mini_cluster.cc:1428] Setting key e450b1274e735c994ad0312171e4d5a1
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 04:59:56.701553 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:56.688617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:39145 (local address 127.25.214.254:36337)
0807 04:59:56.688763 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:56.688768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:56.689809 (+ 1041us) server_negotiation.cc:407] Connection header received
0807 04:59:56.691303 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:56.691306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:56.691351 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:56.691417 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:56.693036 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.693577 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.695153 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.695509 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.695627 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:56.698244 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:56.698248 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:56.698250 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:56.698273 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:56.699473 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:56.699916 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:56.699918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:56.699920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:56.699993 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:56.700366 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:56.700369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:56.700370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:56.700541 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:56.700619 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:56.701233 (+ 614us) server_negotiation.cc:299] Negotiation successful
0807 04:59:56.701389 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:59:56.702222 32359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:56.689067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36337 (local address 127.25.214.193:39145)
0807 04:59:56.689629 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:56.689690 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:56.691060 (+ 1370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:56.691617 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:56.691626 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:56.692163 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:56.692873 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:56.692896 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.693727 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.693731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:56.695004 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:56.695016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.695672 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.695675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:56.695826 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:56.696442 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:56.696460 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:56.698047 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:56.699580 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:56.699584 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:56.699595 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:56.699833 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:56.700060 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:56.700062 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:56.700063 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:56.700285 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:56.700642 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:56.700647 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:56.700946 (+ 299us) client_negotiation.cc:769] Sending connection context
0807 04:59:56.701137 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 04:59:56.701386 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":150,"threads_started":1}
I20260807 04:59:56.703469 32357 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36337
I20260807 04:59:56.703711 32357 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:56.704291 32357 heartbeater.cc:511] Master 127.25.214.254:36337 requested a full tablet report, sending...
I20260807 04:59:56.705870 32076 ts_manager.cc:194] Registered new tserver with Master: eb5c92656170413f9aa1bc2ba034f65d (127.25.214.193:39447)
I20260807 04:59:56.706951 32076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:39145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 04:59:56.714483 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36337
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:56.831694 32365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:56.832023 32365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:56.832101 32365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:56.837199 32365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:56.837268 32365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:56.837356 32365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 04:59:56.844607 32365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:56.845664 32365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:56.846678 32365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:56.856329 32371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:56.856510 32374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:56.856864 32365 server_base.cc:1034] running on GCE node
W20260807 04:59:56.859890 32370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:56.860440 32365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:56.861191 32365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:56.862360 32365 hybrid_clock.cc:648] HybridClock initialized: now 1786078796862342 us; error 37 us; skew 500 ppm
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:56.865389 32365 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 04:59:56.866360 32365 webserver.cc:460] Webserver started at http://127.25.214.194:33119/ using document root <none> and password file <none>
I20260807 04:59:56.866928 32365 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:56.866991 32365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:56.867203 32365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:56.869405 32365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "a395c994569b4121beb5640e09d4a6c9"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "6f67da7ef35d7cdf17ac495c4dfe92da"
server_key_iv: "1b55ccb8ed7875d740cd9915268b984d"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.869984 32365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "a395c994569b4121beb5640e09d4a6c9"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "6f67da7ef35d7cdf17ac495c4dfe92da"
server_key_iv: "1b55ccb8ed7875d740cd9915268b984d"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.873817 32365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:59:56.876334 32389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.877555 32365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:59:56.877669 32365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "a395c994569b4121beb5640e09d4a6c9"
format_stamp: "Formatted at 2026-08-07 04:59:56 on dist-test-slave-lgr5"
server_key: "6f67da7ef35d7cdf17ac495c4dfe92da"
server_key_iv: "1b55ccb8ed7875d740cd9915268b984d"
server_key_version: "encryptionkey@0"
I20260807 04:59:56.877772 32365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:56.891259 32365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:56.894313 32365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:56.894490 32365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:56.895077 32365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:56.895875 32365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:56.895922 32365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.895974 32365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:56.896003 32365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:56.904318 32365 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:45371
I20260807 04:59:56.904357 32578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:45371 every 8 connection(s)
I20260807 04:59:56.905164 32365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 04:59:56.910806 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 32365
I20260807 04:59:56.910934 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 04:59:56.911209 26459 external_mini_cluster.cc:1428] Setting key 454df054d97756f53d86637667d4b8f0
Aug 07 04:59:56 dist-test-slave-lgr5 krb5kdc[32011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:56.918787 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:56.906878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:43419 (local address 127.25.214.254:36337)
0807 04:59:56.907000 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:56.907004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:56.907795 (+ 791us) server_negotiation.cc:407] Connection header received
0807 04:59:56.909237 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:56.909240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:56.909304 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:56.909383 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:56.910554 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.911286 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.912501 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.912784 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.912887 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:56.915403 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:56.915406 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:56.915408 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:56.915430 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:56.916671 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:56.917145 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:56.917149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:56.917150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:56.917230 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:56.917672 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:56.917675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:56.917676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:56.917864 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:56.917952 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:56.918564 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 04:59:56.918663 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 04:59:56.919931 32585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:56.907235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36337 (local address 127.25.214.194:43419)
0807 04:59:56.907663 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:56.907703 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:56.909012 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:56.909559 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:56.909567 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:56.909952 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:56.910421 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:56.910433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.911405 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.911408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:56.912396 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:56.912409 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:56.912933 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:56.912937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:56.913136 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:56.913677 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:56.913693 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:56.915239 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:56.916780 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:56.916786 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:56.916801 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:56.917052 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:56.917349 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:56.917353 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:56.917355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:56.917542 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:56.917979 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:56.917986 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:56.918320 (+ 334us) client_negotiation.cc:769] Sending connection context
0807 04:59:56.918543 (+ 223us) client_negotiation.cc:240] Negotiation successful
0807 04:59:56.918886 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":122,"threads_started":1}
I20260807 04:59:56.921092 32581 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36337
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 04:59:56.921322 32581 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:56.921785 32581 heartbeater.cc:511] Master 127.25.214.254:36337 requested a full tablet report, sending...
I20260807 04:59:56.922739 32076 ts_manager.cc:194] Registered new tserver with Master: a395c994569b4121beb5640e09d4a6c9 (127.25.214.194:45371)
I20260807 04:59:56.923269 32076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:43419
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 04:59:56.939704 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36337
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:57.054467 32591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:57.054744 32591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:57.054795 32591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:57.058915 32591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:57.058995 32591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:57.059063 32591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 04:59:57.064661 32591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:57.065824 32591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:57.066880 32591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:57.076552 32600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:57.076573 32603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:57.076565 32598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:57.076792 32591 server_base.cc:1034] running on GCE node
I20260807 04:59:57.077293 32591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:57.077925 32591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:57.079087 32591 hybrid_clock.cc:648] HybridClock initialized: now 1786078797079070 us; error 34 us; skew 500 ppm
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[32011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078797, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:57.082108 32591 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 04:59:57.083236 32591 webserver.cc:460] Webserver started at http://127.25.214.195:34871/ using document root <none> and password file <none>
I20260807 04:59:57.083875 32591 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:57.083954 32591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:57.084205 32591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:57.086424 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "9eadba593db849d7a650d0b0d80bb172"
format_stamp: "Formatted at 2026-08-07 04:59:57 on dist-test-slave-lgr5"
server_key: "30a22089994935556bd2e5131a2f581c"
server_key_iv: "c5eea94ad47602bf00f5099f4c164554"
server_key_version: "encryptionkey@0"
I20260807 04:59:57.086995 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "9eadba593db849d7a650d0b0d80bb172"
format_stamp: "Formatted at 2026-08-07 04:59:57 on dist-test-slave-lgr5"
server_key: "30a22089994935556bd2e5131a2f581c"
server_key_iv: "c5eea94ad47602bf00f5099f4c164554"
server_key_version: "encryptionkey@0"
I20260807 04:59:57.090878 32591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 04:59:57.093415 32614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:57.094619 32591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 04:59:57.094727 32591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "9eadba593db849d7a650d0b0d80bb172"
format_stamp: "Formatted at 2026-08-07 04:59:57 on dist-test-slave-lgr5"
server_key: "30a22089994935556bd2e5131a2f581c"
server_key_iv: "c5eea94ad47602bf00f5099f4c164554"
server_key_version: "encryptionkey@0"
I20260807 04:59:57.094831 32591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:57.114710 32591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:57.117569 32591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:57.117739 32591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:57.118330 32591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:59:57.119149 32591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:59:57.119195 32591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:57.119237 32591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:59:57.119266 32591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:57.127717 32591 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:35571
I20260807 04:59:57.127750 349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:35571 every 8 connection(s)
I20260807 04:59:57.128660 32591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 04:59:57.136548 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 32591
I20260807 04:59:57.136686 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 04:59:57.136994 26459 external_mini_cluster.cc:1428] Setting key 1a880aa3b3631f7f41f8cf3930057236
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[32011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078797, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:57.142441 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:57.130502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:42533 (local address 127.25.214.254:36337)
0807 04:59:57.130645 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:57.130650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:57.131511 (+ 861us) server_negotiation.cc:407] Connection header received
0807 04:59:57.132933 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:57.132936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:57.132995 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:57.133073 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:57.134236 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.134760 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.135881 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.136123 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.136213 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:57.138737 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:57.138741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:57.138744 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:57.138774 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:57.140234 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:57.140766 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:57.140770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:57.140772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:57.140854 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:57.141189 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:57.141192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:57.141194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:57.141411 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:57.141505 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:57.142095 (+ 590us) server_negotiation.cc:299] Negotiation successful
0807 04:59:57.142248 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 04:59:57.143404 352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:57.130908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36337 (local address 127.25.214.195:42533)
0807 04:59:57.131342 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 04:59:57.131387 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:59:57.132728 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:59:57.133252 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:59:57.133258 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:59:57.133604 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:59:57.134094 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:57.134108 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.134877 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.134880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:57.135763 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:59:57.135772 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.136258 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.136262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:59:57.136428 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:57.137002 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:59:57.137019 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:59:57.138578 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:59:57.140354 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:57.140361 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:57.140379 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:57.140665 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:57.140944 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:59:57.140947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:59:57.140949 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:59:57.141098 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:59:57.141519 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:59:57.141527 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:59:57.141828 (+ 301us) client_negotiation.cc:769] Sending connection context
0807 04:59:57.142034 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 04:59:57.142424 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":112,"threads_started":1}
I20260807 04:59:57.144737 350 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36337
I20260807 04:59:57.145000 350 heartbeater.cc:464] Registering TS with master...
I20260807 04:59:57.145569 350 heartbeater.cc:511] Master 127.25.214.254:36337 requested a full tablet report, sending...
I20260807 04:59:57.146809 32076 ts_manager.cc:194] Registered new tserver with Master: 9eadba593db849d7a650d0b0d80bb172 (127.25.214.195:35571)
I20260807 04:59:57.147428 32076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:42533
I20260807 04:59:57.150986 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[32011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[32011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 04:59:57.180365 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:57.169986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35180 (local address 127.25.214.193:39447)
0807 04:59:57.170319 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:57.170336 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:57.170361 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:59:57.170421 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:57.170427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:57.170625 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:57.170747 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:57.171470 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.172323 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.173232 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.173652 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.173750 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:57.176578 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:57.176593 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:57.176611 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:57.176646 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:57.178362 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:57.178916 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:57.178922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:57.178923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:57.179018 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:57.179249 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:57.179251 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:57.179252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:57.179546 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:57.179736 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:57.179890 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 04:59:57.180147 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":136,"threads_started":1}
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[32011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:57.191529 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:57.183648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33340 (local address 127.25.214.254:36337)
0807 04:59:57.183782 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:57.183787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:57.183833 (+ 46us) server_negotiation.cc:407] Connection header received
0807 04:59:57.183973 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:57.183976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:57.184021 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:57.184129 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:57.184711 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.185234 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.186028 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:57.186230 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:57.186297 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:57.188834 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:57.188838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:57.188840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:57.188871 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:57.190157 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:57.190505 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:57.190508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:57.190509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:57.190579 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:57.190779 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:57.190782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:57.190783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:57.191021 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:57.191125 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:57.191292 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 04:59:57.191400 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 04:59:57.191972 32076 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33340
I20260807 04:59:57.192677 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 32165
I20260807 04:59:57.205479 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 32365
I20260807 04:59:57.214493 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 32591
I20260807 04:59:57.225587 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 32029
2026-08-07T04:59:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2317 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[373](info): set up 2 sockets
Aug 07 04:59:57 dist-test-slave-lgr5 krb5kdc[373](info): commencing operation
krb5kdc: starting...
W20260807 04:59:58.440217 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260807 04:59:58.691504 26459 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.251s user 0.002s sys 0.000s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260807 04:59:58.799817 26459 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.108s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260807 04:59:58.915416 26459 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.115s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/test-user.keytab.
W20260807 04:59:59.537281 26459 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.622s user 0.000s sys 0.002s
Aug 07 04:59:59 dist-test-slave-lgr5 krb5kdc[373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:59:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:59:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
W20260807 04:59:59.755702 26459 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.25.214.254: real 0.195s user 0.000s sys 0.004s
I20260807 04:59:59.756340 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42103
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:42103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:59:59.870129 395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:59:59.870445 395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:59:59.870494 395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:59:59.874661 395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:59:59.874732 395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:59:59.874750 395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:59:59.874765 395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:59:59.874779 395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:59:59.880245 395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:42103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 04:59:59.881351 395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:59:59.882375 395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:59:59.890470 408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:59.890478 406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:59:59.890477 411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:59:59.890827 395 server_base.cc:1034] running on GCE node
I20260807 04:59:59.891326 395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:59:59.892395 395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:59:59.893563 395 hybrid_clock.cc:648] HybridClock initialized: now 1786078799893540 us; error 35 us; skew 500 ppm
Aug 07 04:59:59 dist-test-slave-lgr5 krb5kdc[373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078799, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:59:59.896382 395 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 04:59:59.897143 395 fs_manager.cc:359] Metadata directory not provided
I20260807 04:59:59.897213 395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:59:59.897445 395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:59:59.899492 395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "57e35d38e64844b18dcfffb13ee4b4c1"
format_stamp: "Formatted at 2026-08-07 04:59:59 on dist-test-slave-lgr5"
server_key: "e77674757c3dd51f60500f85beac3948"
server_key_iv: "4b2cf62cc0afd452c83fd5444c255a99"
server_key_version: "encryptionkey@0"
I20260807 04:59:59.900072 395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "57e35d38e64844b18dcfffb13ee4b4c1"
format_stamp: "Formatted at 2026-08-07 04:59:59 on dist-test-slave-lgr5"
server_key: "e77674757c3dd51f60500f85beac3948"
server_key_iv: "4b2cf62cc0afd452c83fd5444c255a99"
server_key_version: "encryptionkey@0"
I20260807 04:59:59.904037 395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:59:59.906543 422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:59:59.907807 395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 04:59:59.907945 395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "57e35d38e64844b18dcfffb13ee4b4c1"
format_stamp: "Formatted at 2026-08-07 04:59:59 on dist-test-slave-lgr5"
server_key: "e77674757c3dd51f60500f85beac3948"
server_key_iv: "4b2cf62cc0afd452c83fd5444c255a99"
server_key_version: "encryptionkey@0"
I20260807 04:59:59.908044 395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:59:59.926625 395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:59:59.929898 395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:59:59.930104 395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:59:59.937434 395 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:42103
I20260807 04:59:59.937736 495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:42103 every 8 connection(s)
I20260807 04:59:59.938395 395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 04:59:59.941445 496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:59:59.943921 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 395
I20260807 04:59:59.944067 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 04:59:59.944527 26459 external_mini_cluster.cc:1428] Setting key cd5c5e5f5617ff354a7a25af94861362
I20260807 04:59:59.948459 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1: Bootstrap starting.
I20260807 04:59:59.951495 496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1: Neither blocks nor log segments found. Creating new log.
I20260807 04:59:59.952456 496 log.cc:824] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1: Log is configured to *not* fsync() on all Append() calls
Aug 07 04:59:59 dist-test-slave-lgr5 krb5kdc[373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 04:59:59.954990 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1: No bootstrap required, opened a new log
I20260807 04:59:59.958913 496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42103 } }
I20260807 04:59:59.959225 496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:59:59.959306 496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57e35d38e64844b18dcfffb13ee4b4c1, State: Initialized, Role: FOLLOWER
I20260807 04:59:59.959797 496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42103 } }
I20260807 04:59:59.959931 496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:59:59.959995 496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:59:59.960120 496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:59:59.960180 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:59:59.946564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34148 (local address 127.25.214.254:42103)
0807 04:59:59.947117 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 04:59:59.947133 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:59:59.947174 (+ 41us) server_negotiation.cc:407] Connection header received
0807 04:59:59.947848 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:59:59.947866 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:59:59.948312 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:59:59.948657 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:59:59.949649 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:59.950698 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:59.951892 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:59:59.952424 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:59:59.952556 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:59:59.955459 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:59:59.955465 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:59:59.955479 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:59:59.955513 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:59:59.957138 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:59.957577 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:59.957582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:59.957588 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:59.957704 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:59:59.957977 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:59:59.957980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:59:59.957981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:59:59.958410 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:59:59.958603 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 04:59:59.958926 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 04:59:59.959236 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":176,"threads_started":1}
I20260807 04:59:59.961354 496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42103 } }
I20260807 04:59:59.961773 496 leader_election.cc:302] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57e35d38e64844b18dcfffb13ee4b4c1; no voters:
I20260807 04:59:59.962136 496 leader_election.cc:288] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:59:59.962240 501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:59:59.962500 501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [term 1 LEADER]: Becoming Leader. State: Replica: 57e35d38e64844b18dcfffb13ee4b4c1, State: Running, Role: LEADER
I20260807 04:59:59.962831 501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42103 } }
I20260807 04:59:59.963495 496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:59:59.964519 504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42103 } } }
I20260807 04:59:59.964669 504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:59.964951 505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e35d38e64844b18dcfffb13ee4b4c1. Latest consensus state: current_term: 1 leader_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e35d38e64844b18dcfffb13ee4b4c1" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42103 } } }
I20260807 04:59:59.965057 505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1 [sys.catalog]: This master's current role is: LEADER
I20260807 04:59:59.965713 515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:59:59.968940 515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:59:59.976438 515 catalog_manager.cc:1347] Generated new cluster ID: 7bea5753365242e5a38679408cb16098
I20260807 04:59:59.976519 515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:59:59.986693 515 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:59:59.987990 515 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:59:59.996917 515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1: Generated new TSK 0
I20260807 04:59:59.997833 515 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:00:00.035125 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42103
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:00.150436 535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:00.150723 535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:00.150769 535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:00.154757 535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:00.154827 535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:00.154886 535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:00.160189 535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:00.161285 535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:00.162312 535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:00.171823 545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:00.171823 541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:00.171847 542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:00.172119 535 server_base.cc:1034] running on GCE node
I20260807 05:00:00.172598 535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:00.173233 535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:00.174392 535 hybrid_clock.cc:648] HybridClock initialized: now 1786078800174365 us; error 37 us; skew 500 ppm
Aug 07 05:00:00 dist-test-slave-lgr5 krb5kdc[373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078800, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:00.177079 535 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:00:00.177786 535 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:00.177848 535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:00.178013 535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:00.179939 535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "cb2fd39086bb48db87659fd9c346b4f3"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "f070b7d7439e616a5d6560769de55f64"
server_key_iv: "68fb8e18574899489cb01fc58d6249b6"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.180497 535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "cb2fd39086bb48db87659fd9c346b4f3"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "f070b7d7439e616a5d6560769de55f64"
server_key_iv: "68fb8e18574899489cb01fc58d6249b6"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.184011 535 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:00:00.186353 552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.187573 535 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:00.187677 535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "cb2fd39086bb48db87659fd9c346b4f3"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "f070b7d7439e616a5d6560769de55f64"
server_key_iv: "68fb8e18574899489cb01fc58d6249b6"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.187767 535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:00.202893 535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:00.205965 535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:00.206112 535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:00.206650 535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:00.207435 535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:00.207481 535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.207523 535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:00.207553 535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.216176 535 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:34637
I20260807 05:00:00.216252 722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:34637 every 8 connection(s)
I20260807 05:00:00.216828 535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:00.221663 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 535
I20260807 05:00:00.221776 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:00.222035 26459 external_mini_cluster.cc:1428] Setting key da5a9dfd69b44b40774f4a5cb7cf754e
Aug 07 05:00:00 dist-test-slave-lgr5 krb5kdc[373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078800, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:00.230765 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.218531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:56161 (local address 127.25.214.254:42103)
0807 05:00:00.218694 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.218698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.219566 (+ 868us) server_negotiation.cc:407] Connection header received
0807 05:00:00.220987 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.220991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.221054 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.221139 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:00.222446 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.223070 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.224311 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.224625 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.224746 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.227368 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:00.227371 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:00.227373 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:00.227395 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:00.228810 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.229296 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.229300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.229301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.229375 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.229695 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.229699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.229700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.229879 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:00.229964 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.230456 (+ 492us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.230592 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 05:00:00.231557 726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.218882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42103 (local address 127.25.214.193:56161)
0807 05:00:00.219397 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.219443 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.220755 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.221327 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.221335 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.221734 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:00.222290 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.222307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.223208 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.223211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.224188 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.224199 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.224772 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.224774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.224926 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.225557 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:00.225578 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:00.227203 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:00.228922 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:00.228928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:00.228944 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:00.229201 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:00.229458 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:00.229461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:00.229463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:00.229607 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:00.229979 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:00.229985 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:00.230233 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.230398 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.230724 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:00:00.232791 723 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42103
I20260807 05:00:00.233038 723 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:00.233498 723 heartbeater.cc:511] Master 127.25.214.254:42103 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 05:00:00.235136 445 ts_manager.cc:194] Registered new tserver with Master: cb2fd39086bb48db87659fd9c346b4f3 (127.25.214.193:34637)
I20260807 05:00:00.236294 445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:56161
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:00:00.250557 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42103
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:00.366407 731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:00.366685 731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:00.366734 731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:00.370913 731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:00.370968 731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:00.371031 731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:00.376261 731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:00.377265 731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:00.378243 731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:00.387938 741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:00.387920 738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:00.387956 739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:00.388242 731 server_base.cc:1034] running on GCE node
I20260807 05:00:00.388741 731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:00.389410 731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:00.390574 731 hybrid_clock.cc:648] HybridClock initialized: now 1786078800390544 us; error 42 us; skew 500 ppm
Aug 07 05:00:00 dist-test-slave-lgr5 krb5kdc[373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078800, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:00.393422 731 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:00:00.394167 731 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:00.394243 731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:00.394447 731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:00.396704 731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "7098f4977db04e3a9a557502c90f1a9d"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "eca5f82a18b2855628f5d785880c581b"
server_key_iv: "de52ea99f04c69872b3a2c17301ef170"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.397284 731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "7098f4977db04e3a9a557502c90f1a9d"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "eca5f82a18b2855628f5d785880c581b"
server_key_iv: "de52ea99f04c69872b3a2c17301ef170"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.401113 731 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 05:00:00.403573 749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.404902 731 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:00.405027 731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "7098f4977db04e3a9a557502c90f1a9d"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "eca5f82a18b2855628f5d785880c581b"
server_key_iv: "de52ea99f04c69872b3a2c17301ef170"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.405128 731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:00.419003 731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:00.421968 731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:00.422147 731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:00.422719 731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:00.423542 731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:00.423590 731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.423643 731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:00.423672 731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.432207 731 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:41489
I20260807 05:00:00.432260 923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:41489 every 8 connection(s)
I20260807 05:00:00.432780 731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:00.437856 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 731
I20260807 05:00:00.437994 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:00.438323 26459 external_mini_cluster.cc:1428] Setting key c68fd2003298af7c02dffdafa2267231
Aug 07 05:00:00 dist-test-slave-lgr5 krb5kdc[373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078800, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:00.446516 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.434424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:38849 (local address 127.25.214.254:42103)
0807 05:00:00.434588 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.434592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.435426 (+ 834us) server_negotiation.cc:407] Connection header received
0807 05:00:00.436709 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.436712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.436769 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.436842 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:00.438024 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.438762 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.440233 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.440540 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.440643 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.442939 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:00.442942 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:00.442945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:00.442967 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:00.444277 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.444896 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.444902 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.444903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.444998 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.445374 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.445377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.445378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.445562 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:00.445647 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.446269 (+ 622us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.446391 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 05:00:00.447602 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.434795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42103 (local address 127.25.214.194:38849)
0807 05:00:00.435249 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.435292 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.436505 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.437026 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.437033 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.437373 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:00.437826 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.437866 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.438926 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.438930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.440118 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.440130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.440667 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.440670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.440811 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.441360 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:00.441376 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:00.442784 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:00.444399 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:00.444405 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:00.444422 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:00.444774 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:00.445096 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:00.445099 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:00.445101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:00.445283 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:00.445667 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:00.445673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:00.445988 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.446209 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.446559 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":106,"threads_started":1}
I20260807 05:00:00.448823 926 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42103
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:00:00.449059 926 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:00.449519 926 heartbeater.cc:511] Master 127.25.214.254:42103 requested a full tablet report, sending...
I20260807 05:00:00.450603 445 ts_manager.cc:194] Registered new tserver with Master: 7098f4977db04e3a9a557502c90f1a9d (127.25.214.194:41489)
I20260807 05:00:00.451203 445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:38849
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:00:00.467340 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42103
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:00.580617 932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:00.580925 932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:00.580991 932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:00.585088 932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:00.585152 932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:00.585232 932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:00.590749 932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:00.591936 932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:00.593068 932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:00.602586 938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:00.602586 939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:00.602586 941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:00.602946 932 server_base.cc:1034] running on GCE node
I20260807 05:00:00.603403 932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:00.604058 932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:00.605265 932 hybrid_clock.cc:648] HybridClock initialized: now 1786078800605242 us; error 35 us; skew 500 ppm
Aug 07 05:00:00 dist-test-slave-lgr5 krb5kdc[373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078800, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:00.608155 932 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:00:00.608945 932 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:00.609017 932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:00.609244 932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:00.611428 932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "75a7aa2f5ed54f97b60aba4d102aa09d"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "26207d3d81b870af9d27754279bd6a31"
server_key_iv: "f238bd52ac97d3d41cd05f360ed61432"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.612021 932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "75a7aa2f5ed54f97b60aba4d102aa09d"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "26207d3d81b870af9d27754279bd6a31"
server_key_iv: "f238bd52ac97d3d41cd05f360ed61432"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.615954 932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:00:00.618510 949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.619768 932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:00.619901 932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "75a7aa2f5ed54f97b60aba4d102aa09d"
format_stamp: "Formatted at 2026-08-07 05:00:00 on dist-test-slave-lgr5"
server_key: "26207d3d81b870af9d27754279bd6a31"
server_key_iv: "f238bd52ac97d3d41cd05f360ed61432"
server_key_version: "encryptionkey@0"
I20260807 05:00:00.620024 932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:00.642071 932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:00.645259 932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:00.645448 932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:00.646061 932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:00.646914 932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:00.646961 932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.647008 932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:00.647037 932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:00.655531 932 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:39163
I20260807 05:00:00.655555 1146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:39163 every 8 connection(s)
I20260807 05:00:00.656148 932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:00.664324 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 932
I20260807 05:00:00.664472 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:00.664860 26459 external_mini_cluster.cc:1428] Setting key 0c0a5717ab925a85b70d5f685397401b
Aug 07 05:00:00 dist-test-slave-lgr5 krb5kdc[373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078800, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:00.669734 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.657894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:44091 (local address 127.25.214.254:42103)
0807 05:00:00.658102 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.658107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.658952 (+ 845us) server_negotiation.cc:407] Connection header received
0807 05:00:00.660324 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.660328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.660381 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.660457 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:00.661730 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.662266 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.663528 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.663736 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.663811 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.666670 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:00.666673 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:00.666675 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:00.666698 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:00.667951 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.668450 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.668453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.668454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.668529 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.668790 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.668792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.668793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.668968 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:00.669039 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.669501 (+ 462us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.669610 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 05:00:00.670527 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.658290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42103 (local address 127.25.214.195:44091)
0807 05:00:00.658786 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.658834 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.660071 (+ 1237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.660621 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.660628 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.661026 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:00.661586 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.661602 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.662398 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.662401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.663424 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.663435 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.663857 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.663859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.664051 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.664777 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:00.664801 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:00.666518 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:00.668050 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:00.668055 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:00.668068 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:00.668364 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:00.668592 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:00.668594 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:00.668595 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:00.668723 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:00.669037 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:00.669041 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:00.669280 (+ 239us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.669430 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.669692 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":121,"threads_started":1}
I20260807 05:00:00.671645 1148 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42103
I20260807 05:00:00.671903 1148 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:00.672438 1148 heartbeater.cc:511] Master 127.25.214.254:42103 requested a full tablet report, sending...
I20260807 05:00:00.673487 445 ts_manager.cc:194] Registered new tserver with Master: 75a7aa2f5ed54f97b60aba4d102aa09d (127.25.214.195:39163)
I20260807 05:00:00.674036 445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:44091
I20260807 05:00:00.678987 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:00:00.688377 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.680997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34154 (local address 127.25.214.254:42103)
0807 05:00:00.681115 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.681118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.681279 (+ 161us) server_negotiation.cc:407] Connection header received
0807 05:00:00.681430 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.681433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.681482 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.681553 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:00.682216 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.682741 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.683585 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.683802 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.683888 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.685308 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:00.685324 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:00.685326 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:00.685353 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:00.686823 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.687209 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.687212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.687213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.687289 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:00.687511 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:00.687513 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:00.687514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:00.687757 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:00.687876 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.688067 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.688219 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:00:00.691691 445 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:00.694839 445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:00.709512 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.703541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:41489 (local address 127.0.0.1:50944)
0807 05:00:00.704477 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.704489 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.704628 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.705344 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.705346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.705362 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:00.705493 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.705498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.706956 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.706958 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.708065 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.708100 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.708921 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.708924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.709033 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.709070 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.709182 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.709309 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":61,"thread_start_us":128,"threads_started":1}
I20260807 05:00:00.709518 1171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.703892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.25.214.194:41489)
0807 05:00:00.704326 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.704338 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.704566 (+ 228us) server_negotiation.cc:407] Connection header received
0807 05:00:00.704773 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.704779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.705002 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.705132 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:00.705624 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.706782 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.708193 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.708797 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.708915 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.709072 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.709246 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.709341 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":123,"threads_started":1}
I20260807 05:00:00.709770 1168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.703430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39163 (local address 127.0.0.1:44066)
0807 05:00:00.704368 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.704435 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.704563 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.705622 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.705625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.705644 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:00.705736 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.705742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.706717 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.706721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.708210 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.708218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.709355 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.709360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.709454 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.709479 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.709537 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.709608 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":46,"thread_start_us":71,"threads_started":1}
I20260807 05:00:00.710178 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.704074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:34637 (local address 127.0.0.1:46976)
0807 05:00:00.704669 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.704684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.704783 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.705215 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.705223 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.705250 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:00.705440 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.705449 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.706924 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.706927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.708189 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.708203 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.709522 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.709526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.709765 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.709790 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.709970 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.710046 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":13,"thread_start_us":106,"threads_started":1}
I20260807 05:00:00.710572 1170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.703566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44066 (local address 127.25.214.195:39163)
0807 05:00:00.705196 (+ 1630us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.705209 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.705231 (+ 22us) server_negotiation.cc:407] Connection header received
0807 05:00:00.705316 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.705321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.705502 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.705649 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:00.705842 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.706578 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.708360 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.709190 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.710101 (+ 911us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.710235 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.710291 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.710404 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1524,"thread_start_us":122,"threads_started":1}
I20260807 05:00:00.710597 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.704271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46976 (local address 127.25.214.193:34637)
0807 05:00:00.704822 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.704829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.704849 (+ 20us) server_negotiation.cc:407] Connection header received
0807 05:00:00.704915 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.704919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.705060 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.705190 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:00.705571 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.706782 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.708350 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.709190 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.709325 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.709458 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.710363 (+ 905us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.710451 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":146,"threads_started":1}
I20260807 05:00:00.712951 822 tablet_service.cc:1467] Processing CreateTablet for tablet d39af44829fa409db850cd207d95a8a7 (DEFAULT_TABLE table=test-table [id=a8054654f12b4dc69cea91f03ab697ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:00.713112 624 tablet_service.cc:1467] Processing CreateTablet for tablet d39af44829fa409db850cd207d95a8a7 (DEFAULT_TABLE table=test-table [id=a8054654f12b4dc69cea91f03ab697ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:00.713480 1032 tablet_service.cc:1467] Processing CreateTablet for tablet d39af44829fa409db850cd207d95a8a7 (DEFAULT_TABLE table=test-table [id=a8054654f12b4dc69cea91f03ab697ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:00.714144 624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39af44829fa409db850cd207d95a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:00.714145 822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39af44829fa409db850cd207d95a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:00.714303 1032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39af44829fa409db850cd207d95a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:00.720810 1175 tablet_bootstrap.cc:492] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Bootstrap starting.
I20260807 05:00:00.722151 1176 tablet_bootstrap.cc:492] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Bootstrap starting.
I20260807 05:00:00.722295 1177 tablet_bootstrap.cc:492] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3: Bootstrap starting.
I20260807 05:00:00.723737 1175 tablet_bootstrap.cc:654] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:00.724429 1176 tablet_bootstrap.cc:654] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:00.724429 1177 tablet_bootstrap.cc:654] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:00.725193 1175 log.cc:824] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:00.725751 1176 log.cc:824] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:00.726569 1177 log.cc:824] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:00.727756 1175 tablet_bootstrap.cc:492] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: No bootstrap required, opened a new log
I20260807 05:00:00.727927 1176 tablet_bootstrap.cc:492] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: No bootstrap required, opened a new log
I20260807 05:00:00.727995 1175 ts_tablet_manager.cc:1397] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260807 05:00:00.728168 1176 ts_tablet_manager.cc:1397] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260807 05:00:00.728672 1177 tablet_bootstrap.cc:492] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3: No bootstrap required, opened a new log
I20260807 05:00:00.728856 1177 ts_tablet_manager.cc:1397] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 05:00:00.731142 1175 raft_consensus.cc:348] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.731437 1175 raft_consensus.cc:374] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:00.731505 1175 raft_consensus.cc:729] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a7aa2f5ed54f97b60aba4d102aa09d, State: Initialized, Role: FOLLOWER
I20260807 05:00:00.732017 1175 consensus_queue.cc:260] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.732008 1176 raft_consensus.cc:348] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.732287 1176 raft_consensus.cc:374] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:00.732338 1176 raft_consensus.cc:729] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7098f4977db04e3a9a557502c90f1a9d, State: Initialized, Role: FOLLOWER
I20260807 05:00:00.732614 1177 raft_consensus.cc:348] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.732738 1176 consensus_queue.cc:260] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.732852 1177 raft_consensus.cc:374] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:00.732897 1177 raft_consensus.cc:729] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb2fd39086bb48db87659fd9c346b4f3, State: Initialized, Role: FOLLOWER
I20260807 05:00:00.733186 1175 ts_tablet_manager.cc:1428] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 05:00:00.733587 1148 heartbeater.cc:503] Master 127.25.214.254:42103 was elected leader, sending a full tablet report...
I20260807 05:00:00.733661 1176 ts_tablet_manager.cc:1428] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:00:00.733821 926 heartbeater.cc:503] Master 127.25.214.254:42103 was elected leader, sending a full tablet report...
I20260807 05:00:00.733322 1177 consensus_queue.cc:260] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.735265 723 heartbeater.cc:503] Master 127.25.214.254:42103 was elected leader, sending a full tablet report...
I20260807 05:00:00.735517 1177 ts_tablet_manager.cc:1428] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 05:00:00.864770 1186 raft_consensus.cc:482] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:00.864975 1186 raft_consensus.cc:504] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.866138 1186 leader_election.cc:288] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a7aa2f5ed54f97b60aba4d102aa09d (127.25.214.195:39163), 7098f4977db04e3a9a557502c90f1a9d (127.25.214.194:41489)
I20260807 05:00:00.871342 1171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.866584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:38255 (local address 127.25.214.194:41489)
0807 05:00:00.866753 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.866758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.866927 (+ 169us) server_negotiation.cc:407] Connection header received
0807 05:00:00.867078 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.867081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.867131 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.867214 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:00.867581 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.868400 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.870038 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.870661 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.870780 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.870846 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.871124 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.871194 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 05:00:00.871361 1170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.866659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:40861 (local address 127.25.214.195:39163)
0807 05:00:00.866782 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.866786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.866908 (+ 122us) server_negotiation.cc:407] Connection header received
0807 05:00:00.867078 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.867081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.867131 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.867214 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:00.867581 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.868412 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.870038 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.870662 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.870780 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.870838 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.871124 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.871194 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:00:00.871383 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.866401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:41489 (local address 127.25.214.193:38255)
0807 05:00:00.866836 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.866848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.866972 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.867233 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.867236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.867261 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:00.867473 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.867479 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.868508 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.868512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.869914 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.869927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.870781 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.870785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.871004 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.871021 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.871102 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.871194 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":292,"spinlock_wait_cycles":28672,"thread_start_us":135,"threads_started":1}
I20260807 05:00:00.871387 1187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.866378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39163 (local address 127.25.214.193:40861)
0807 05:00:00.866801 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.866821 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:00.866972 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:00.867233 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:00.867236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:00.867261 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:00.867464 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.867473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.868508 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.868512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.869914 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:00.869927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.870781 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.870785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:00.870979 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.871021 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 05:00:00.871102 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 05:00:00.871194 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":69,"spinlock_wait_cycles":14720,"thread_start_us":139,"threads_started":1}
I20260807 05:00:00.872126 852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39af44829fa409db850cd207d95a8a7" candidate_uuid: "cb2fd39086bb48db87659fd9c346b4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7098f4977db04e3a9a557502c90f1a9d" is_pre_election: true
I20260807 05:00:00.872458 852 raft_consensus.cc:2454] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb2fd39086bb48db87659fd9c346b4f3 in term 0.
I20260807 05:00:00.872453 1064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39af44829fa409db850cd207d95a8a7" candidate_uuid: "cb2fd39086bb48db87659fd9c346b4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" is_pre_election: true
I20260807 05:00:00.872710 1064 raft_consensus.cc:2454] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb2fd39086bb48db87659fd9c346b4f3 in term 0.
I20260807 05:00:00.873003 559 leader_election.cc:302] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7098f4977db04e3a9a557502c90f1a9d, cb2fd39086bb48db87659fd9c346b4f3; no voters:
I20260807 05:00:00.873308 1186 raft_consensus.cc:2781] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:00.873406 1186 raft_consensus.cc:482] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:00.873459 1186 raft_consensus.cc:3037] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:00.874508 1186 raft_consensus.cc:504] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.874821 1186 leader_election.cc:288] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [CANDIDATE]: Term 1 election: Requested vote from peers 75a7aa2f5ed54f97b60aba4d102aa09d (127.25.214.195:39163), 7098f4977db04e3a9a557502c90f1a9d (127.25.214.194:41489)
I20260807 05:00:00.875217 852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39af44829fa409db850cd207d95a8a7" candidate_uuid: "cb2fd39086bb48db87659fd9c346b4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7098f4977db04e3a9a557502c90f1a9d"
I20260807 05:00:00.875217 1064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39af44829fa409db850cd207d95a8a7" candidate_uuid: "cb2fd39086bb48db87659fd9c346b4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d"
I20260807 05:00:00.875348 852 raft_consensus.cc:3037] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:00.875348 1064 raft_consensus.cc:3037] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:00.876688 852 raft_consensus.cc:2454] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb2fd39086bb48db87659fd9c346b4f3 in term 1.
I20260807 05:00:00.876688 1064 raft_consensus.cc:2454] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb2fd39086bb48db87659fd9c346b4f3 in term 1.
I20260807 05:00:00.877007 556 leader_election.cc:302] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7098f4977db04e3a9a557502c90f1a9d, 75a7aa2f5ed54f97b60aba4d102aa09d, cb2fd39086bb48db87659fd9c346b4f3; no voters:
I20260807 05:00:00.877210 1186 raft_consensus.cc:2781] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:00.877430 1186 raft_consensus.cc:686] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [term 1 LEADER]: Becoming Leader. State: Replica: cb2fd39086bb48db87659fd9c346b4f3, State: Running, Role: LEADER
I20260807 05:00:00.877733 1186 consensus_queue.cc:237] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } }
I20260807 05:00:00.880993 445 catalog_manager.cc:5495] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb2fd39086bb48db87659fd9c346b4f3 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "cb2fd39086bb48db87659fd9c346b4f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb2fd39086bb48db87659fd9c346b4f3" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 34637 } health_report { overall_health: HEALTHY } } }
I20260807 05:00:00.905287 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.901969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46990 (local address 127.25.214.193:34637)
0807 05:00:00.902082 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:00.902086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:00.902100 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:00.902172 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:00.902174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:00.902225 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:00.902310 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:00.902529 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.903051 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.903871 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:00.904092 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:00.904179 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:00.904519 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:00.904923 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:00.905029 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:00.905100 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 05:00:00.905154 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 05:00:00.906996 1150 tablet.cc:2369] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:00:00.910857 1064 raft_consensus.cc:1261] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 1 FOLLOWER]: Refusing update from remote peer cb2fd39086bb48db87659fd9c346b4f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:00.910871 852 raft_consensus.cc:1261] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 1 FOLLOWER]: Refusing update from remote peer cb2fd39086bb48db87659fd9c346b4f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:00.911486 1189 consensus_queue.cc:1035] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7098f4977db04e3a9a557502c90f1a9d" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:00.911649 1186 consensus_queue.cc:1035] T d39af44829fa409db850cd207d95a8a7 P cb2fd39086bb48db87659fd9c346b4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a7aa2f5ed54f97b60aba4d102aa09d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:00.920318 1195 mvcc.cc:205] Tried to move back new op lower bound from 7315778768524599296 to 7315778768398053376. Current Snapshot: MvccSnapshot[applied={T|T < 7315778768524599296}]
I20260807 05:00:00.921186 1193 mvcc.cc:205] Tried to move back new op lower bound from 7315778768524599296 to 7315778768398053376. Current Snapshot: MvccSnapshot[applied={T|T < 7315778768524599296 or (T in {7315778768524599296})}]
I20260807 05:00:00.921868 1194 mvcc.cc:205] Tried to move back new op lower bound from 7315778768524599296 to 7315778768398053376. Current Snapshot: MvccSnapshot[applied={T|T < 7315778768524599296}]
I20260807 05:00:00.926127 445 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:00.926290 445 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:00.928681 445 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57e35d38e64844b18dcfffb13ee4b4c1: Sending DeleteTablet for 3 replicas of tablet d39af44829fa409db850cd207d95a8a7
I20260807 05:00:00.929443 1032 tablet_service.cc:1514] Processing DeleteTablet for tablet d39af44829fa409db850cd207d95a8a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:00 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:44066
I20260807 05:00:00.929621 822 tablet_service.cc:1514] Processing DeleteTablet for tablet d39af44829fa409db850cd207d95a8a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:00 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:50944
I20260807 05:00:00.929617 624 tablet_service.cc:1514] Processing DeleteTablet for tablet d39af44829fa409db850cd207d95a8a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:00 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:46976
I20260807 05:00:00.930171 1210 tablet_replica.cc:330] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: stopping tablet replica
I20260807 05:00:00.930168 1211 tablet_replica.cc:330] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: stopping tablet replica
I20260807 05:00:00.930516 1211 raft_consensus.cc:2229] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:00.930516 1210 raft_consensus.cc:2229] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:00.930755 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 535
I20260807 05:00:00.933972 1210 raft_consensus.cc:2258] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:00.939503 1211 raft_consensus.cc:2258] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:00.940502 1210 ts_tablet_manager.cc:1905] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:00.942247 1211 ts_tablet_manager.cc:1905] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:00.943681 1210 ts_tablet_manager.cc:1918] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:00.943913 1210 log.cc:1196] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/d39af44829fa409db850cd207d95a8a7
I20260807 05:00:00.944346 1210 ts_tablet_manager.cc:1939] T d39af44829fa409db850cd207d95a8a7 P 75a7aa2f5ed54f97b60aba4d102aa09d: Deleting consensus metadata
I20260807 05:00:00.944828 1211 ts_tablet_manager.cc:1918] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:00.944933 1211 log.cc:1196] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/d39af44829fa409db850cd207d95a8a7
I20260807 05:00:00.945216 1211 ts_tablet_manager.cc:1939] T d39af44829fa409db850cd207d95a8a7 P 7098f4977db04e3a9a557502c90f1a9d: Deleting consensus metadata
I20260807 05:00:00.946182 425 catalog_manager.cc:4841] TS 75a7aa2f5ed54f97b60aba4d102aa09d (127.25.214.195:39163): tablet d39af44829fa409db850cd207d95a8a7 (table test-table [id=a8054654f12b4dc69cea91f03ab697ef]) successfully deleted
I20260807 05:00:00.946412 427 catalog_manager.cc:4841] TS 7098f4977db04e3a9a557502c90f1a9d (127.25.214.194:41489): tablet d39af44829fa409db850cd207d95a8a7 (table test-table [id=a8054654f12b4dc69cea91f03ab697ef]) successfully deleted
I20260807 05:00:00.950116 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 731
W20260807 05:00:00.950178 424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:34637 (error 108)
I20260807 05:00:00.956983 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:00.956701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:34637 (local address 127.0.0.1:47004)
0807 05:00:00.956826 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:00.956901 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 05:00:00.957140 424 catalog_manager.cc:4584] TS cb2fd39086bb48db87659fd9c346b4f3 (127.25.214.193:34637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d39af44829fa409db850cd207d95a8a7: Network error: Client connection negotiation failed: client connection to 127.25.214.193:34637: connect: Connection refused (error 111)
I20260807 05:00:00.961992 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 932
I20260807 05:00:00.981542 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 395
2026-08-07T05:00:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3749 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T05:00:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:01Z Disabled control of system clock
I20260807 05:00:01.015779 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45287
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:36227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:45287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 05:00:01.131843 1219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:01.132136 1219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:01.132174 1219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:01.136049 1219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:01.136119 1219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:01.136134 1219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:01.136149 1219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:01.136163 1219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:01.140913 1219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:45287
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:01.141916 1219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:01.143234 1219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:00:01.151520 1219 server_base.cc:1034] running on GCE node
W20260807 05:00:01.151482 1233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.151481 1230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.151489 1226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:01.152273 1219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:01.153323 1219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:01.154498 1219 hybrid_clock.cc:648] HybridClock initialized: now 1786078801154482 us; error 36 us; skew 500 ppm
I20260807 05:00:01.156360 1219 webserver.cc:460] Webserver started at http://127.25.214.254:38055/ using document root <none> and password file <none>
I20260807 05:00:01.156934 1219 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:01.156999 1219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:01.157192 1219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:01.159241 1219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "681cbb15b96c4b08ba85781d91628457"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "cda0523b253cf1e79512e169ffb87983"
server_key_iv: "8df3be834b633979fcd0eba75ec8711a"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.159770 1219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "681cbb15b96c4b08ba85781d91628457"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "cda0523b253cf1e79512e169ffb87983"
server_key_iv: "8df3be834b633979fcd0eba75ec8711a"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.163317 1219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 05:00:01.165763 1246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.166965 1219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:01.167081 1219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "681cbb15b96c4b08ba85781d91628457"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "cda0523b253cf1e79512e169ffb87983"
server_key_iv: "8df3be834b633979fcd0eba75ec8711a"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.167181 1219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:01.171768 1219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:01.172454 1219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:01.172627 1219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:01.179685 1219 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:45287
I20260807 05:00:01.179701 1325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:45287 every 8 connection(s)
I20260807 05:00:01.180722 1219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:01.181260 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 1219
I20260807 05:00:01.181396 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:01.181667 26459 external_mini_cluster.cc:1428] Setting key e78a78110f16dbcdbf38cb43d59253a9
I20260807 05:00:01.183822 1327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:01.188508 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.183105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42340 (local address 127.25.214.254:45287)
0807 05:00:01.184337 (+ 1232us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.184356 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.184400 (+ 44us) server_negotiation.cc:407] Connection header received
0807 05:00:01.185269 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.185291 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.185741 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.186130 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.186891 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.186896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.186912 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.186924 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.186992 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.187015 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.187174 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.187242 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.187509 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":610,"threads_started":1}
I20260807 05:00:01.191057 1327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457: Bootstrap starting.
I20260807 05:00:01.193233 1327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:01.194033 1327 log.cc:824] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:01.195983 1327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457: No bootstrap required, opened a new log
I20260807 05:00:01.199591 1327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681cbb15b96c4b08ba85781d91628457" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45287 } }
I20260807 05:00:01.199869 1327 raft_consensus.cc:374] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:01.199927 1327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681cbb15b96c4b08ba85781d91628457, State: Initialized, Role: FOLLOWER
I20260807 05:00:01.200397 1327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681cbb15b96c4b08ba85781d91628457" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45287 } }
I20260807 05:00:01.200525 1327 raft_consensus.cc:388] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:01.200589 1327 raft_consensus.cc:482] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:01.200685 1327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:01.201668 1327 raft_consensus.cc:504] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681cbb15b96c4b08ba85781d91628457" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45287 } }
I20260807 05:00:01.201987 1327 leader_election.cc:302] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 681cbb15b96c4b08ba85781d91628457; no voters:
I20260807 05:00:01.202276 1327 leader_election.cc:288] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:01.202400 1337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:01.202600 1337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [term 1 LEADER]: Becoming Leader. State: Replica: 681cbb15b96c4b08ba85781d91628457, State: Running, Role: LEADER
I20260807 05:00:01.202913 1337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681cbb15b96c4b08ba85781d91628457" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45287 } }
I20260807 05:00:01.203544 1327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:01.204638 1338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "681cbb15b96c4b08ba85781d91628457" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681cbb15b96c4b08ba85781d91628457" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45287 } } }
I20260807 05:00:01.204664 1339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 681cbb15b96c4b08ba85781d91628457. Latest consensus state: current_term: 1 leader_uuid: "681cbb15b96c4b08ba85781d91628457" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681cbb15b96c4b08ba85781d91628457" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45287 } } }
I20260807 05:00:01.204877 1338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:01.204900 1339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:01.205852 1352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:01.208535 1352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:01.214828 1352 catalog_manager.cc:1347] Generated new cluster ID: ac7b14fb21f74f3a85a7eb3bcf38c2be
I20260807 05:00:01.214905 1352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:01.235406 1352 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:01.235773 1352 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:01.243103 1352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457: Generated new TSK 0
I20260807 05:00:01.243862 1352 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:00:01.253700 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45287
--builtin_ntp_servers=127.25.214.212:36227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 05:00:01.389438 1364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:01.389741 1364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:01.389783 1364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:01.394068 1364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:01.394152 1364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:01.394212 1364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:01.399169 1364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:01.400444 1364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:01.401852 1364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:01.411490 1371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:01.411613 1364 server_base.cc:1034] running on GCE node
W20260807 05:00:01.411490 1369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.411661 1374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:01.412181 1364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:01.412820 1364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:01.413987 1364 hybrid_clock.cc:648] HybridClock initialized: now 1786078801413969 us; error 32 us; skew 500 ppm
I20260807 05:00:01.422470 1364 webserver.cc:460] Webserver started at http://127.25.214.193:45269/ using document root <none> and password file <none>
I20260807 05:00:01.423133 1364 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:01.423216 1364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:01.423466 1364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:01.425788 1364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "f61406f40b2f428fab6487c9333f1b5c"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "e144cecaf421cacfbd21a800324b9a79"
server_key_iv: "5b6960b6d84ba39cb8c2b3ae3c878570"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.426399 1364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "f61406f40b2f428fab6487c9333f1b5c"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "e144cecaf421cacfbd21a800324b9a79"
server_key_iv: "5b6960b6d84ba39cb8c2b3ae3c878570"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.430403 1364 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:00:01.433184 1382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.434463 1364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:01.434584 1364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "f61406f40b2f428fab6487c9333f1b5c"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "e144cecaf421cacfbd21a800324b9a79"
server_key_iv: "5b6960b6d84ba39cb8c2b3ae3c878570"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.434692 1364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:01.439329 1364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:01.439953 1364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:01.440151 1364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:01.440733 1364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:01.441718 1364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:01.441767 1364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.441820 1364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:01.441847 1364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.450779 1364 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:42709
I20260807 05:00:01.450800 1571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:42709 every 8 connection(s)
I20260807 05:00:01.451743 1364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:01.452353 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 1364
I20260807 05:00:01.452477 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:01.452735 26459 external_mini_cluster.cc:1428] Setting key cb6ee4e0de0be0e5970b822a1861b053
I20260807 05:00:01.454988 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45287
--builtin_ntp_servers=127.25.214.212:36227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 05:00:01.458470 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.453608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:33217 (local address 127.25.214.254:45287)
0807 05:00:01.453735 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.453739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.455036 (+ 1297us) server_negotiation.cc:407] Connection header received
0807 05:00:01.456596 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.456600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.456650 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.456735 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.458005 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.458008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.458010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.458020 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.458040 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.458048 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.458118 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.458250 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.458302 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:00:01.459339 1575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.454175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45287 (local address 127.25.214.193:33217)
0807 05:00:01.454889 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.454931 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.456355 (+ 1424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.456959 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.456969 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.457091 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.457690 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.457692 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.457754 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.457852 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.458111 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.458117 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.458121 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.458272 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.458532 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":142,"threads_started":1}
I20260807 05:00:01.460762 1573 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45287
I20260807 05:00:01.461004 1573 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:01.461427 1573 heartbeater.cc:511] Master 127.25.214.254:45287 requested a full tablet report, sending...
I20260807 05:00:01.463207 1274 ts_manager.cc:194] Registered new tserver with Master: f61406f40b2f428fab6487c9333f1b5c (127.25.214.193:42709)
W20260807 05:00:01.569181 1577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:01.569458 1577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:01.569499 1577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:01.573504 1577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:01.573557 1577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:01.573611 1577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:01.578284 1577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:01.579295 1577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:01.580659 1577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:01.589807 1585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.589891 1588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.589818 1584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:01.590030 1577 server_base.cc:1034] running on GCE node
I20260807 05:00:01.590490 1577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:01.591094 1577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:01.592253 1577 hybrid_clock.cc:648] HybridClock initialized: now 1786078801592232 us; error 41 us; skew 500 ppm
I20260807 05:00:01.593987 1577 webserver.cc:460] Webserver started at http://127.25.214.194:45809/ using document root <none> and password file <none>
I20260807 05:00:01.594556 1577 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:01.594624 1577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:01.594818 1577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:01.597002 1577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "359f5d44a4af452e947ddfd4174a6ec5"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "9e0bbca012da3defab168e8e3608a188"
server_key_iv: "9de3ac5a41a8f250e8b4f40619a6eee3"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.597579 1577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "359f5d44a4af452e947ddfd4174a6ec5"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "9e0bbca012da3defab168e8e3608a188"
server_key_iv: "9de3ac5a41a8f250e8b4f40619a6eee3"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.601385 1577 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:00:01.603852 1600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.605136 1577 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:01.605284 1577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "359f5d44a4af452e947ddfd4174a6ec5"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "9e0bbca012da3defab168e8e3608a188"
server_key_iv: "9de3ac5a41a8f250e8b4f40619a6eee3"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.605396 1577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:01.609926 1577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:01.610502 1577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:01.610653 1577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:01.611179 1577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:01.612136 1577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:01.612190 1577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.612241 1577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:01.612267 1577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.620481 1577 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:39213
I20260807 05:00:01.620512 1779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:39213 every 8 connection(s)
I20260807 05:00:01.621450 1577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:01.622283 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 1577
I20260807 05:00:01.622406 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:01.622709 26459 external_mini_cluster.cc:1428] Setting key b421968a38f017c5813ca4a41c228ba2
I20260807 05:00:01.624912 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45287
--builtin_ntp_servers=127.25.214.212:36227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 05:00:01.627768 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.623433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:60679 (local address 127.25.214.254:45287)
0807 05:00:01.623563 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.623568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.624814 (+ 1246us) server_negotiation.cc:407] Connection header received
0807 05:00:01.626106 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.626109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.626153 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.626229 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.627328 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.627331 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.627334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.627347 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.627369 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.627377 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.627453 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.627583 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.627629 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:00:01.628835 1783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.623895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45287 (local address 127.25.214.194:60679)
0807 05:00:01.624665 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.624707 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.625902 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.626416 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.626422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.626510 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.627066 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.627068 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.627108 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.627180 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.627446 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.627455 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.627461 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.627619 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.627863 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":169,"threads_started":1}
I20260807 05:00:01.629947 1780 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45287
I20260807 05:00:01.630199 1780 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:01.630715 1780 heartbeater.cc:511] Master 127.25.214.254:45287 requested a full tablet report, sending...
I20260807 05:00:01.631846 1274 ts_manager.cc:194] Registered new tserver with Master: 359f5d44a4af452e947ddfd4174a6ec5 (127.25.214.194:39213)
W20260807 05:00:01.739238 1784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:01.739491 1784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:01.739557 1784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:01.743554 1784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:01.743604 1784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:01.743676 1784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:01.748360 1784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:36227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:01.749593 1784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:01.751008 1784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:01.760341 1803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.760388 1799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:01.760275 1797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:01.760552 1784 server_base.cc:1034] running on GCE node
I20260807 05:00:01.761691 1784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:01.762422 1784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:01.763608 1784 hybrid_clock.cc:648] HybridClock initialized: now 1786078801763587 us; error 35 us; skew 500 ppm
I20260807 05:00:01.765463 1784 webserver.cc:460] Webserver started at http://127.25.214.195:33573/ using document root <none> and password file <none>
I20260807 05:00:01.766047 1784 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:01.766111 1784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:01.766325 1784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:01.768494 1784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "717eb969d18f44338bb363e1c0dd2a69"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "d6fdd013733d61553f018fba73da3053"
server_key_iv: "40b7ebd5e36473913833f53d1a3b32b1"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.769060 1784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "717eb969d18f44338bb363e1c0dd2a69"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "d6fdd013733d61553f018fba73da3053"
server_key_iv: "40b7ebd5e36473913833f53d1a3b32b1"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.772778 1784 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 05:00:01.775290 1811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.776585 1784 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 05:00:01.776690 1784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "717eb969d18f44338bb363e1c0dd2a69"
format_stamp: "Formatted at 2026-08-07 05:00:01 on dist-test-slave-lgr5"
server_key: "d6fdd013733d61553f018fba73da3053"
server_key_iv: "40b7ebd5e36473913833f53d1a3b32b1"
server_key_version: "encryptionkey@0"
I20260807 05:00:01.776796 1784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:01.781383 1784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:01.782008 1784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:01.782163 1784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:01.782717 1784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:01.783659 1784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:01.783708 1784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.783747 1784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:01.783776 1784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:01.792523 1784 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:37727
I20260807 05:00:01.792567 2001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:37727 every 8 connection(s)
I20260807 05:00:01.793437 1784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:01.799497 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.795328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:32915 (local address 127.25.214.254:45287)
0807 05:00:01.795459 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.795462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.796581 (+ 1119us) server_negotiation.cc:407] Connection header received
0807 05:00:01.797879 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.797883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.797932 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.798008 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.799059 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.799062 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.799065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.799079 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.799098 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.799106 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.799186 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.799301 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.799347 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:00:01.800403 2008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.795718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45287 (local address 127.25.214.195:32915)
0807 05:00:01.796431 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.796473 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.797671 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.798176 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.798183 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.798267 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.798794 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.798796 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.798835 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.798910 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.799174 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.799182 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.799188 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.799341 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.799576 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":121,"threads_started":1}
I20260807 05:00:01.801501 2004 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45287
I20260807 05:00:01.801714 2004 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:01.802109 2004 heartbeater.cc:511] Master 127.25.214.254:45287 requested a full tablet report, sending...
I20260807 05:00:01.802778 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 1784
I20260807 05:00:01.802886 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:01.803100 1274 ts_manager.cc:194] Registered new tserver with Master: 717eb969d18f44338bb363e1c0dd2a69 (127.25.214.195:37727)
I20260807 05:00:01.803154 26459 external_mini_cluster.cc:1428] Setting key fcd7fa3959174b7f152ba59059f01a79
I20260807 05:00:01.805065 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:00:01.808434 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.806950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42348 (local address 127.25.214.254:45287)
0807 05:00:01.807064 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.807068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.807245 (+ 177us) server_negotiation.cc:407] Connection header received
0807 05:00:01.807293 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.807295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.807329 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.807407 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.808062 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.808066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.808069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.808098 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.808119 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.808127 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.808197 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.808289 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.808322 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:00:01.811128 1274 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:01.814160 1274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:01.825724 2023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.822536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:39213 (local address 127.0.0.1:42074)
0807 05:00:01.823472 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.823523 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.823631 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.824273 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.824279 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.824350 (+ 71us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.824875 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.824877 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.824896 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.824964 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.825363 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.825384 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.825391 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.825505 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.825578 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"spinlock_wait_cycles":7936,"thread_start_us":87,"threads_started":1}
I20260807 05:00:01.825747 2027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.822938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.25.214.194:39213)
0807 05:00:01.823890 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.823901 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.823921 (+ 20us) server_negotiation.cc:407] Connection header received
0807 05:00:01.823967 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.823972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.824139 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.824257 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.825095 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.825102 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.825115 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.825128 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.825176 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.825213 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.825316 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.825542 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.825616 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":841,"thread_start_us":147,"threads_started":1}
I20260807 05:00:01.825941 2025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.822461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:37727 (local address 127.0.0.1:58978)
0807 05:00:01.823472 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.823523 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.823631 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.824853 (+ 1222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.824856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.824868 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.825274 (+ 406us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.825276 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.825287 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.825312 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.825691 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.825694 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.825697 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.825762 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.825797 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"spinlock_wait_cycles":2176,"thread_start_us":86,"threads_started":1}
I20260807 05:00:01.826656 2026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.822638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58978 (local address 127.25.214.195:37727)
0807 05:00:01.823155 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.823167 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.823739 (+ 572us) server_negotiation.cc:407] Connection header received
0807 05:00:01.823800 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.823807 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.824003 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.824162 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.825453 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.825460 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.825470 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.825482 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.825525 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.825556 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.825652 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.826442 (+ 790us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.826510 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":169,"threads_started":1}
I20260807 05:00:01.826697 2028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.823177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42709 (local address 127.0.0.1:45420)
0807 05:00:01.823930 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.823943 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.824026 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.824872 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.824875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.824891 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.825553 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.825554 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.825563 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.825590 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.826348 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.826351 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.826354 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.826565 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.826592 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":86,"threads_started":1}
I20260807 05:00:01.827138 2029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.823450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45420 (local address 127.25.214.193:42709)
0807 05:00:01.823899 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.823911 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.824019 (+ 108us) server_negotiation.cc:407] Connection header received
0807 05:00:01.824137 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.824143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.824308 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.824446 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.825707 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.825713 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.825723 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.825734 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.825771 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.826202 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.826298 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.826933 (+ 635us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.826999 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":93,"threads_started":1}
I20260807 05:00:01.828984 1676 tablet_service.cc:1467] Processing CreateTablet for tablet c2eea05fcc2a43e783745b8238990d09 (DEFAULT_TABLE table=test-table [id=5226512134324962b7db71394d4ede5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:01.829298 1892 tablet_service.cc:1467] Processing CreateTablet for tablet c2eea05fcc2a43e783745b8238990d09 (DEFAULT_TABLE table=test-table [id=5226512134324962b7db71394d4ede5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:01.829712 1456 tablet_service.cc:1467] Processing CreateTablet for tablet c2eea05fcc2a43e783745b8238990d09 (DEFAULT_TABLE table=test-table [id=5226512134324962b7db71394d4ede5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:01.830144 1676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2eea05fcc2a43e783745b8238990d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:01.830312 1892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2eea05fcc2a43e783745b8238990d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:01.830631 1456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2eea05fcc2a43e783745b8238990d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:01.836189 2030 tablet_bootstrap.cc:492] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Bootstrap starting.
I20260807 05:00:01.837728 2033 tablet_bootstrap.cc:492] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c: Bootstrap starting.
I20260807 05:00:01.838769 2030 tablet_bootstrap.cc:654] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:01.839491 2030 log.cc:824] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:01.839574 2033 tablet_bootstrap.cc:654] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:01.840137 2032 tablet_bootstrap.cc:492] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Bootstrap starting.
I20260807 05:00:01.840451 2033 log.cc:824] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:01.841714 2032 tablet_bootstrap.cc:654] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:01.842136 2033 tablet_bootstrap.cc:492] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c: No bootstrap required, opened a new log
I20260807 05:00:01.842306 2033 ts_tablet_manager.cc:1397] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:00:01.842329 2032 log.cc:824] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:01.843909 2030 tablet_bootstrap.cc:492] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: No bootstrap required, opened a new log
I20260807 05:00:01.844123 2030 ts_tablet_manager.cc:1397] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20260807 05:00:01.844244 2032 tablet_bootstrap.cc:492] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: No bootstrap required, opened a new log
I20260807 05:00:01.844432 2032 ts_tablet_manager.cc:1397] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260807 05:00:01.846647 2033 raft_consensus.cc:348] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.846947 2033 raft_consensus.cc:374] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:01.847008 2033 raft_consensus.cc:729] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61406f40b2f428fab6487c9333f1b5c, State: Initialized, Role: FOLLOWER
I20260807 05:00:01.847381 2030 raft_consensus.cc:348] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.847572 2030 raft_consensus.cc:374] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:01.847506 2033 consensus_queue.cc:260] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.847630 2030 raft_consensus.cc:729] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359f5d44a4af452e947ddfd4174a6ec5, State: Initialized, Role: FOLLOWER
I20260807 05:00:01.848208 1573 heartbeater.cc:503] Master 127.25.214.254:45287 was elected leader, sending a full tablet report...
I20260807 05:00:01.848584 2033 ts_tablet_manager.cc:1428] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:00:01.848614 2032 raft_consensus.cc:348] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.848851 2032 raft_consensus.cc:374] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:01.848907 2032 raft_consensus.cc:729] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717eb969d18f44338bb363e1c0dd2a69, State: Initialized, Role: FOLLOWER
I20260807 05:00:01.849093 2030 consensus_queue.cc:260] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.849283 2032 consensus_queue.cc:260] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.849756 1780 heartbeater.cc:503] Master 127.25.214.254:45287 was elected leader, sending a full tablet report...
I20260807 05:00:01.850033 2030 ts_tablet_manager.cc:1428] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260807 05:00:01.850158 2032 ts_tablet_manager.cc:1428] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:00:01.850721 2004 heartbeater.cc:503] Master 127.25.214.254:45287 was elected leader, sending a full tablet report...
I20260807 05:00:01.864564 2042 raft_consensus.cc:482] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:01.864732 2042 raft_consensus.cc:504] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.865813 2042 leader_election.cc:288] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359f5d44a4af452e947ddfd4174a6ec5 (127.25.214.194:39213), f61406f40b2f428fab6487c9333f1b5c (127.25.214.193:42709)
I20260807 05:00:01.867532 2008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.866032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:39213 (local address 127.25.214.195:34129)
0807 05:00:01.866198 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.866212 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.866291 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.866537 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.866540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.866553 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.867001 (+ 448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.867002 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.867015 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.867045 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.867297 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.867299 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.867301 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.867373 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.867409 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 05:00:01.867547 2027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.866102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:34129 (local address 127.25.214.194:39213)
0807 05:00:01.866212 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.866217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.866259 (+ 42us) server_negotiation.cc:407] Connection header received
0807 05:00:01.866395 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.866398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.866436 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.866504 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.867164 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.867169 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.867172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.867187 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.867211 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.867222 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.867315 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.867373 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.867419 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 05:00:01.867571 2043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.866094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42709 (local address 127.25.214.195:47859)
0807 05:00:01.866444 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.866454 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:01.866537 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:01.866746 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:01.866749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:01.866761 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:01.867089 (+ 328us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:01.867090 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:01.867099 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:01.867120 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:01.867370 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:01.867373 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:01.867375 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 05:00:01.867443 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 05:00:01.867468 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":129,"threads_started":1}
I20260807 05:00:01.867581 2029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.866171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:47859 (local address 127.25.214.193:42709)
0807 05:00:01.866296 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.866300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.866541 (+ 241us) server_negotiation.cc:407] Connection header received
0807 05:00:01.866613 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.866615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.866646 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.866706 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.867230 (+ 524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.867233 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.867236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.867248 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.867267 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.867276 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.867357 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.867443 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.867478 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 05:00:01.868151 1711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2eea05fcc2a43e783745b8238990d09" candidate_uuid: "717eb969d18f44338bb363e1c0dd2a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359f5d44a4af452e947ddfd4174a6ec5" is_pre_election: true
I20260807 05:00:01.868239 1500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2eea05fcc2a43e783745b8238990d09" candidate_uuid: "717eb969d18f44338bb363e1c0dd2a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61406f40b2f428fab6487c9333f1b5c" is_pre_election: true
I20260807 05:00:01.868439 1711 raft_consensus.cc:2454] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717eb969d18f44338bb363e1c0dd2a69 in term 0.
I20260807 05:00:01.868506 1500 raft_consensus.cc:2454] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717eb969d18f44338bb363e1c0dd2a69 in term 0.
I20260807 05:00:01.868899 1816 leader_election.cc:302] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 359f5d44a4af452e947ddfd4174a6ec5, 717eb969d18f44338bb363e1c0dd2a69, f61406f40b2f428fab6487c9333f1b5c; no voters:
I20260807 05:00:01.869145 2042 raft_consensus.cc:2781] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:01.869230 2042 raft_consensus.cc:482] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:01.869282 2042 raft_consensus.cc:3037] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:01.870415 2042 raft_consensus.cc:504] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
I20260807 05:00:01.870756 2042 leader_election.cc:288] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [CANDIDATE]: Term 1 election: Requested vote from peers 359f5d44a4af452e947ddfd4174a6ec5 (127.25.214.194:39213), f61406f40b2f428fab6487c9333f1b5c (127.25.214.193:42709)
I20260807 05:00:01.871097 1500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2eea05fcc2a43e783745b8238990d09" candidate_uuid: "717eb969d18f44338bb363e1c0dd2a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61406f40b2f428fab6487c9333f1b5c"
I20260807 05:00:01.871208 1500 raft_consensus.cc:3037] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:01.872267 1500 raft_consensus.cc:2454] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717eb969d18f44338bb363e1c0dd2a69 in term 1.
I20260807 05:00:01.872493 1711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2eea05fcc2a43e783745b8238990d09" candidate_uuid: "717eb969d18f44338bb363e1c0dd2a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359f5d44a4af452e947ddfd4174a6ec5"
I20260807 05:00:01.872531 1813 leader_election.cc:302] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717eb969d18f44338bb363e1c0dd2a69, f61406f40b2f428fab6487c9333f1b5c; no voters:
I20260807 05:00:01.872596 1711 raft_consensus.cc:3037] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:01.872675 2042 raft_consensus.cc:2781] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:01.872879 2042 raft_consensus.cc:686] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 1 LEADER]: Becoming Leader. State: Replica: 717eb969d18f44338bb363e1c0dd2a69, State: Running, Role: LEADER
I20260807 05:00:01.873194 2042 consensus_queue.cc:237] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } }
W20260807 05:00:01.873499 1781 tablet.cc:2369] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:00:01.873687 1711 raft_consensus.cc:2454] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717eb969d18f44338bb363e1c0dd2a69 in term 1.
I20260807 05:00:01.876367 1271 catalog_manager.cc:5495] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 717eb969d18f44338bb363e1c0dd2a69 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "717eb969d18f44338bb363e1c0dd2a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717eb969d18f44338bb363e1c0dd2a69" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 37727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:01.887710 2026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.886361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58994 (local address 127.25.214.195:37727)
0807 05:00:01.886484 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:01.886489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:01.886503 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:01.886635 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:01.886637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:01.886690 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:01.886757 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:01.887360 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:01.887364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:01.887367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:01.887377 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:01.887395 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:01.887402 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:01.887471 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:01.887555 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 05:00:01.887591 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:00:01.893187 1711 raft_consensus.cc:1261] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 1 FOLLOWER]: Refusing update from remote peer 717eb969d18f44338bb363e1c0dd2a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:01.893186 1500 raft_consensus.cc:1261] T c2eea05fcc2a43e783745b8238990d09 P f61406f40b2f428fab6487c9333f1b5c [term 1 FOLLOWER]: Refusing update from remote peer 717eb969d18f44338bb363e1c0dd2a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:01.893846 2042 consensus_queue.cc:1035] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61406f40b2f428fab6487c9333f1b5c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:01.894033 2044 consensus_queue.cc:1035] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359f5d44a4af452e947ddfd4174a6ec5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 39213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:01.901027 2048 mvcc.cc:205] Tried to move back new op lower bound from 7315778772547457024 to 7315778772475817984. Current Snapshot: MvccSnapshot[applied={T|T < 7315778772547457024}]
I20260807 05:00:01.901234 2049 mvcc.cc:205] Tried to move back new op lower bound from 7315778772547457024 to 7315778772475817984. Current Snapshot: MvccSnapshot[applied={T|T < 7315778772547457024}]
I20260807 05:00:01.902096 2051 mvcc.cc:205] Tried to move back new op lower bound from 7315778772547457024 to 7315778772475817984. Current Snapshot: MvccSnapshot[applied={T|T < 7315778772547457024}]
I20260807 05:00:01.909652 1274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:01.909804 1274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:01.912061 1274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 681cbb15b96c4b08ba85781d91628457: Sending DeleteTablet for 3 replicas of tablet c2eea05fcc2a43e783745b8238990d09
I20260807 05:00:01.912885 1456 tablet_service.cc:1514] Processing DeleteTablet for tablet c2eea05fcc2a43e783745b8238990d09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:01 UTC) from {username='slave'} at 127.0.0.1:45420
I20260807 05:00:01.912885 1676 tablet_service.cc:1514] Processing DeleteTablet for tablet c2eea05fcc2a43e783745b8238990d09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:01 UTC) from {username='slave'} at 127.0.0.1:42074
I20260807 05:00:01.912953 1892 tablet_service.cc:1514] Processing DeleteTablet for tablet c2eea05fcc2a43e783745b8238990d09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:01 UTC) from {username='slave'} at 127.0.0.1:58978
I20260807 05:00:01.913362 2064 tablet_replica.cc:330] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: stopping tablet replica
I20260807 05:00:01.913645 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 1364
I20260807 05:00:01.932881 2065 tablet_replica.cc:330] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: stopping tablet replica
I20260807 05:00:01.933305 2065 raft_consensus.cc:2229] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:01.933801 2065 raft_consensus.cc:2258] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:01.939015 2065 ts_tablet_manager.cc:1905] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:01.941311 2065 ts_tablet_manager.cc:1918] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:01.941411 2065 log.cc:1196] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/c2eea05fcc2a43e783745b8238990d09
I20260807 05:00:01.941689 2065 ts_tablet_manager.cc:1939] T c2eea05fcc2a43e783745b8238990d09 P 717eb969d18f44338bb363e1c0dd2a69: Deleting consensus metadata
I20260807 05:00:01.942903 2064 raft_consensus.cc:2229] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:01.942904 1249 catalog_manager.cc:4841] TS 717eb969d18f44338bb363e1c0dd2a69 (127.25.214.195:37727): tablet c2eea05fcc2a43e783745b8238990d09 (table test-table [id=5226512134324962b7db71394d4ede5c]) successfully deleted
I20260807 05:00:01.943269 2064 raft_consensus.cc:2258] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:01.944705 2064 ts_tablet_manager.cc:1905] T c2eea05fcc2a43e783745b8238990d09 P 359f5d44a4af452e947ddfd4174a6ec5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 05:00:01.944962 1249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:42709 (error 108)
I20260807 05:00:01.946075 2028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.945749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42709 (local address 127.0.0.1:45436)
0807 05:00:01.945891 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.945981 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:42709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 05:00:01.946122 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 1577
W20260807 05:00:01.952306 1249 catalog_manager.cc:4584] TS f61406f40b2f428fab6487c9333f1b5c (127.25.214.193:42709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2eea05fcc2a43e783745b8238990d09: Network error: Client connection negotiation failed: client connection to 127.25.214.193:42709: connect: Connection refused (error 111)
I20260807 05:00:01.959093 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 1784
I20260807 05:00:01.962389 2028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:01.959278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:39213 (local address 127.0.0.1:42086)
0807 05:00:01.962245 (+ 2967us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:01.962302 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.194:39213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2870}
I20260807 05:00:01.973821 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 1219
2026-08-07T05:00:01Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (991 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 05:00:01.999528 26459 mini_oidc.cc:152] Starting JWKS server
I20260807 05:00:02.001585 26459 webserver.cc:460] Webserver started at https://127.0.0.1:42365/ using document root <none> and password file <none>
I20260807 05:00:02.001741 26459 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 05:00:02.001986 26459 webserver.cc:460] Webserver started at http://127.0.0.1:34571/ using document root <none> and password file <none>
2026-08-07T05:00:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:02Z Disabled control of system clock
I20260807 05:00:02.011584 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45495
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:45495
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42365/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/testchainca.cert with env {}
W20260807 05:00:02.123762 2075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:02.124044 2075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:02.124123 2075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:02.128029 2075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:02.128108 2075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:02.128131 2075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:02.128154 2075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:02.128182 2075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 05:00:02.128211 2075 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 05:00:02.128237 2075 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42365/jwks.json
I20260807 05:00:02.133479 2075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:45495
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42365/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:02.134521 2075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:02.135526 2075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:02.143683 2085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:02.143664 2082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:02.143767 2075 server_base.cc:1034] running on GCE node
W20260807 05:00:02.143657 2083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:02.144435 2075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:02.145426 2075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:02.146588 2075 hybrid_clock.cc:648] HybridClock initialized: now 1786078802146573 us; error 34 us; skew 500 ppm
I20260807 05:00:02.148485 2075 webserver.cc:460] Webserver started at http://127.25.214.254:38115/ using document root <none> and password file <none>
I20260807 05:00:02.149048 2075 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:02.149109 2075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:02.149310 2075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:02.151378 2075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "e2ef3c53af5e40c7ae7e493d07439d7b"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "13a7c18bb01f30ae60933296d6bb9f29"
server_key_iv: "58f185eb05c91a2df813256bc2c970b0"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.151978 2075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "e2ef3c53af5e40c7ae7e493d07439d7b"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "13a7c18bb01f30ae60933296d6bb9f29"
server_key_iv: "58f185eb05c91a2df813256bc2c970b0"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.155558 2075 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:02.157998 2097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:02.159197 2075 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:02.159314 2075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "e2ef3c53af5e40c7ae7e493d07439d7b"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "13a7c18bb01f30ae60933296d6bb9f29"
server_key_iv: "58f185eb05c91a2df813256bc2c970b0"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.159409 2075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:02.176175 2075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:02.176903 2075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:02.177099 2075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:02.183908 2075 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:45495
I20260807 05:00:02.183926 2190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:45495 every 8 connection(s)
I20260807 05:00:02.184945 2075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:02.188014 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 2075
I20260807 05:00:02.188162 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:02.188302 2191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:02.188503 26459 external_mini_cluster.cc:1428] Setting key 398deba19a351a844ab918bcfc91b503
I20260807 05:00:02.195175 2191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b: Bootstrap starting.
I20260807 05:00:02.197415 2194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:02.189823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40096 (local address 127.25.214.254:45495)
0807 05:00:02.190410 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:02.190425 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:02.190460 (+ 35us) server_negotiation.cc:407] Connection header received
0807 05:00:02.191090 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:02.191107 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:02.191483 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:02.191746 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:02.192140 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.193158 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.194330 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.194767 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.194877 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.195745 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:02.195750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:02.195762 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:02.196178 (+ 416us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:02.196235 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:02.196256 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:02.196327 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:02.196476 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 05:00:02.196729 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":102,"threads_started":1}
I20260807 05:00:02.197538 2191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:02.198249 2191 log.cc:824] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:02.199958 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:00:02.200187 2191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b: No bootstrap required, opened a new log
I20260807 05:00:02.203754 2191 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45495 } }
I20260807 05:00:02.203959 2191 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:02.203996 2191 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ef3c53af5e40c7ae7e493d07439d7b, State: Initialized, Role: FOLLOWER
I20260807 05:00:02.204377 2191 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45495 } }
I20260807 05:00:02.204500 2191 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:02.204545 2191 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:02.204612 2191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:02.205382 2191 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45495 } }
I20260807 05:00:02.205721 2191 leader_election.cc:302] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2ef3c53af5e40c7ae7e493d07439d7b; no voters:
I20260807 05:00:02.205999 2191 leader_election.cc:288] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:02.206084 2200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:02.206274 2200 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [term 1 LEADER]: Becoming Leader. State: Replica: e2ef3c53af5e40c7ae7e493d07439d7b, State: Running, Role: LEADER
I20260807 05:00:02.206571 2200 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45495 } }
I20260807 05:00:02.207113 2191 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:02.208042 2201 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45495 } } }
I20260807 05:00:02.208190 2201 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:02.208216 2205 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2ef3c53af5e40c7ae7e493d07439d7b. Latest consensus state: current_term: 1 leader_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ef3c53af5e40c7ae7e493d07439d7b" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45495 } } }
I20260807 05:00:02.208309 2205 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:02.208642 2214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:02.211603 2214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:02.216809 2214 catalog_manager.cc:1347] Generated new cluster ID: ac9a8ad2a0be4da58efc49305cd1e2e7
I20260807 05:00:02.216866 2214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:02.230705 2214 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:02.231963 2214 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:02.242929 2214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2ef3c53af5e40c7ae7e493d07439d7b: Generated new TSK 0
I20260807 05:00:02.243907 2214 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 05:00:02.280961 2243 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 05:00:02.281111 2243 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 05:00:02.281838 2194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:02.264291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40098 (local address 127.25.214.254:45495)
0807 05:00:02.264430 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:02.264435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:02.264616 (+ 181us) server_negotiation.cc:407] Connection header received
0807 05:00:02.264811 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:02.264814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:02.264873 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:02.264985 (+ 112us) server_negotiation.cc:226] Negotiated authn=JWT
0807 05:00:02.265198 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.266029 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.266842 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.267190 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.267294 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.267599 (+ 305us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 05:00:02.281380 (+ 13781us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 05:00:02.281690 (+ 310us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40098: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 05:00:02.281909 2194 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40098: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 05:00:02.283155 2242 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:02.264222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45495 (local address 127.0.0.1:40098)
0807 05:00:02.264536 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:02.264550 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:02.264661 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:02.264987 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:02.264989 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:02.264995 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0807 05:00:02.265105 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:02.265111 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.266119 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.266121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:02.266732 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:02.266739 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.267293 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.267295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:02.267361 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.267407 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 05:00:02.281639 (+ 14232us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 05:00:02.281876 (+ 237us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.214.254:45495: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":114,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.25.214.254:45495: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 05:00:02.283881 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 2075
2026-08-07T05:00:02Z chronyd exiting
I20260807 05:00:02.327312 26459 test_util.cc:175] -----------------------------------------------
I20260807 05:00:02.327404 26459 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786078774062608-26459-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (329 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 05:00:02.328583 26459 mini_oidc.cc:152] Starting JWKS server
I20260807 05:00:02.329437 26459 webserver.cc:460] Webserver started at https://127.0.0.1:36651/ using document root <none> and password file <none>
I20260807 05:00:02.329525 26459 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 05:00:02.329770 26459 webserver.cc:460] Webserver started at http://127.0.0.1:33675/ using document root <none> and password file <none>
2026-08-07T05:00:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:02Z Disabled control of system clock
I20260807 05:00:02.339406 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:37743
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:35335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:37743
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36651/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/testchainca.cert with env {}
W20260807 05:00:02.451437 2250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:02.451701 2250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:02.451740 2250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:02.455658 2250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:02.455713 2250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:02.455727 2250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:02.455742 2250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:02.455755 2250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 05:00:02.455770 2250 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 05:00:02.455785 2250 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36651/jwks.json
I20260807 05:00:02.461024 2250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:37743
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:37743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36651/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:02.462008 2250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:02.462951 2250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:02.471087 2258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:02.471211 2250 server_base.cc:1034] running on GCE node
W20260807 05:00:02.471100 2261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:02.471091 2256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:02.471836 2250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:02.472949 2250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:02.474123 2250 hybrid_clock.cc:648] HybridClock initialized: now 1786078802474100 us; error 39 us; skew 500 ppm
I20260807 05:00:02.475975 2250 webserver.cc:460] Webserver started at http://127.25.214.254:40551/ using document root <none> and password file <none>
I20260807 05:00:02.476564 2250 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:02.476636 2250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:02.476836 2250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:02.478880 2250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "84fc5b49d449401eb2b3a806c1f7a01d"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "2ce6e05de5f7f0004dff611de5739b80"
server_key_iv: "3b06f94b9ad74e8f096a00cbacea72ca"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.479437 2250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "84fc5b49d449401eb2b3a806c1f7a01d"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "2ce6e05de5f7f0004dff611de5739b80"
server_key_iv: "3b06f94b9ad74e8f096a00cbacea72ca"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.482956 2250 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 05:00:02.485730 2269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:02.486933 2250 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:02.487069 2250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "84fc5b49d449401eb2b3a806c1f7a01d"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "2ce6e05de5f7f0004dff611de5739b80"
server_key_iv: "3b06f94b9ad74e8f096a00cbacea72ca"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.487169 2250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:02.511650 2250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:02.512339 2250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:02.512517 2250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:02.519266 2250 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:37743
I20260807 05:00:02.519282 2355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:37743 every 8 connection(s)
I20260807 05:00:02.520186 2250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:02.523648 2356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:02.525282 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 2250
I20260807 05:00:02.525389 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:02.525655 26459 external_mini_cluster.cc:1428] Setting key 06ccca77cfddda2a67d54b37cf59b1aa
I20260807 05:00:02.530368 2356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d: Bootstrap starting.
I20260807 05:00:02.533206 2356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:02.534005 2356 log.cc:824] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:02.535235 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:02.527063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38358 (local address 127.25.214.254:37743)
0807 05:00:02.527718 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:02.527733 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:02.527771 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:00:02.528497 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:02.528519 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:02.528917 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:02.529204 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:02.529615 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.530686 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.531931 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.532482 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.532611 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.533504 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:02.533509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:02.533522 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:02.533899 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:02.533955 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:02.533976 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:02.534050 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:02.534225 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 05:00:02.534507 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":142,"threads_started":1}
I20260807 05:00:02.536054 2356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d: No bootstrap required, opened a new log
I20260807 05:00:02.537899 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:00:02.539858 2356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 37743 } }
I20260807 05:00:02.540112 2356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:02.540189 2356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84fc5b49d449401eb2b3a806c1f7a01d, State: Initialized, Role: FOLLOWER
I20260807 05:00:02.540607 2356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 37743 } }
I20260807 05:00:02.540776 2356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:02.540861 2356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:02.540977 2356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:02.541944 2356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 37743 } }
I20260807 05:00:02.542269 2356 leader_election.cc:302] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84fc5b49d449401eb2b3a806c1f7a01d; no voters:
I20260807 05:00:02.542584 2356 leader_election.cc:288] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:02.542704 2361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:02.542951 2361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [term 1 LEADER]: Becoming Leader. State: Replica: 84fc5b49d449401eb2b3a806c1f7a01d, State: Running, Role: LEADER
I20260807 05:00:02.543216 2361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 37743 } }
I20260807 05:00:02.543764 2356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:02.545164 2362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 37743 } } }
I20260807 05:00:02.545310 2362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:02.545544 2364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84fc5b49d449401eb2b3a806c1f7a01d. Latest consensus state: current_term: 1 leader_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fc5b49d449401eb2b3a806c1f7a01d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 37743 } } }
I20260807 05:00:02.545653 2364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d [sys.catalog]: This master's current role is: LEADER
W20260807 05:00:02.548765 2385 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:00:02.548839 2385 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:00:02.548914 2375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:02.549597 2375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:02.555131 2375 catalog_manager.cc:1347] Generated new cluster ID: 0a2f65cf06954487be5c1c401fc9efae
I20260807 05:00:02.555197 2375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:02.569918 2375 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:02.570931 2375 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:02.576469 2375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84fc5b49d449401eb2b3a806c1f7a01d: Generated new TSK 0
I20260807 05:00:02.577148 2375 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 05:00:02.599831 2403 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 05:00:02.599934 2403 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 05:00:02.600701 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:02.585102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38364 (local address 127.25.214.254:37743)
0807 05:00:02.585222 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:02.585226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:02.585405 (+ 179us) server_negotiation.cc:407] Connection header received
0807 05:00:02.585592 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:02.585594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:02.585646 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:02.585741 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0807 05:00:02.585978 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.586533 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.587392 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.587613 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.587699 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.588015 (+ 316us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 05:00:02.600268 (+ 12253us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 05:00:02.600553 (+ 285us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38364: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 05:00:02.600780 2359 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38364: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 05:00:02.600836 2402 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:02.585013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:37743 (local address 127.0.0.1:38364)
0807 05:00:02.585324 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:02.585336 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:02.585448 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:02.585751 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:02.585754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:02.585762 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 05:00:02.585874 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:02.585881 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.586648 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.586652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:02.587276 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:02.587284 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.587720 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.587724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:02.587814 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.587838 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 05:00:02.600470 (+ 12632us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 05:00:02.600669 (+ 199us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.214.254:37743: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36651/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":130,"threads_started":1}
I20260807 05:00:02.601523 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 2250
2026-08-07T05:00:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (320 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 05:00:02.649441 26459 mini_oidc.cc:152] Starting JWKS server
I20260807 05:00:02.650291 26459 webserver.cc:460] Webserver started at https://127.0.0.1:41071/ using document root <none> and password file <none>
I20260807 05:00:02.650383 26459 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 05:00:02.650625 26459 webserver.cc:460] Webserver started at http://127.0.0.1:42681/ using document root <none> and password file <none>
2026-08-07T05:00:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:02Z Disabled control of system clock
I20260807 05:00:02.659937 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43235
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43235
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41071/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 05:00:02.772121 2416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:02.772418 2416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:02.772459 2416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:02.776526 2416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:02.776597 2416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:02.776610 2416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:02.776625 2416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:02.776639 2416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 05:00:02.776660 2416 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 05:00:02.776672 2416 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41071/jwks.json
I20260807 05:00:02.781543 2416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43235
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41071/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:02.782711 2416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:02.784211 2416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:02.792750 2421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:02.792786 2427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:02.792831 2416 server_base.cc:1034] running on GCE node
W20260807 05:00:02.792759 2423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:02.793704 2416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:02.794991 2416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:02.796188 2416 hybrid_clock.cc:648] HybridClock initialized: now 1786078802796160 us; error 42 us; skew 500 ppm
I20260807 05:00:02.798288 2416 webserver.cc:460] Webserver started at http://127.25.214.254:36693/ using document root <none> and password file <none>
I20260807 05:00:02.798885 2416 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:02.798964 2416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:02.799178 2416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:02.801367 2416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "55f645c33e7e483db1f760edef7de5fc"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "5662e8d3517651f5a60ebc652306c122"
server_key_iv: "8ea1240165fecd86326e994a345fac33"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.801937 2416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "55f645c33e7e483db1f760edef7de5fc"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "5662e8d3517651f5a60ebc652306c122"
server_key_iv: "8ea1240165fecd86326e994a345fac33"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.805670 2416 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 05:00:02.807991 2437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:02.809204 2416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:02.809315 2416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "55f645c33e7e483db1f760edef7de5fc"
format_stamp: "Formatted at 2026-08-07 05:00:02 on dist-test-slave-lgr5"
server_key: "5662e8d3517651f5a60ebc652306c122"
server_key_iv: "8ea1240165fecd86326e994a345fac33"
server_key_version: "encryptionkey@0"
I20260807 05:00:02.809418 2416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:02.841652 2416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:02.842438 2416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:02.842614 2416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:02.849531 2416 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43235
I20260807 05:00:02.849561 2523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43235 every 8 connection(s)
I20260807 05:00:02.850477 2416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:02.853418 2524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:02.855938 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 2416
I20260807 05:00:02.856114 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:02.856428 26459 external_mini_cluster.cc:1428] Setting key 7c48c2f97b5c7bdf8c24964f092ceb08
I20260807 05:00:02.859673 2524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc: Bootstrap starting.
I20260807 05:00:02.862304 2524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:02.863157 2524 log.cc:824] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:02.865423 2524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc: No bootstrap required, opened a new log
I20260807 05:00:02.866189 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:02.858025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.25.214.254:43235)
0807 05:00:02.858750 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:02.858766 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:02.858807 (+ 41us) server_negotiation.cc:407] Connection header received
0807 05:00:02.859482 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:02.859500 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:02.859968 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:02.860333 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:02.860714 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.861737 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.862915 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.863449 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.863615 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.864484 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:02.864490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:02.864504 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:02.864888 (+ 384us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:02.864944 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:02.864966 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:02.865045 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:02.865192 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 05:00:02.865452 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":136,"threads_started":1}
I20260807 05:00:02.868947 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:00:02.869086 2524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f645c33e7e483db1f760edef7de5fc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43235 } }
I20260807 05:00:02.869364 2524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:02.869417 2524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f645c33e7e483db1f760edef7de5fc, State: Initialized, Role: FOLLOWER
I20260807 05:00:02.869884 2524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f645c33e7e483db1f760edef7de5fc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43235 } }
I20260807 05:00:02.870023 2524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:02.870085 2524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:02.870184 2524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:02.871157 2524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f645c33e7e483db1f760edef7de5fc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43235 } }
I20260807 05:00:02.871479 2524 leader_election.cc:302] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55f645c33e7e483db1f760edef7de5fc; no voters:
I20260807 05:00:02.871758 2524 leader_election.cc:288] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:02.871855 2529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:02.872067 2529 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [term 1 LEADER]: Becoming Leader. State: Replica: 55f645c33e7e483db1f760edef7de5fc, State: Running, Role: LEADER
I20260807 05:00:02.872386 2529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f645c33e7e483db1f760edef7de5fc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43235 } }
I20260807 05:00:02.872927 2524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:02.874001 2531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55f645c33e7e483db1f760edef7de5fc. Latest consensus state: current_term: 1 leader_uuid: "55f645c33e7e483db1f760edef7de5fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f645c33e7e483db1f760edef7de5fc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43235 } } }
I20260807 05:00:02.874001 2530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55f645c33e7e483db1f760edef7de5fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f645c33e7e483db1f760edef7de5fc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43235 } } }
I20260807 05:00:02.874161 2530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:02.874161 2531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:02.874557 2545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:02.877689 2545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:02.883425 2545 catalog_manager.cc:1347] Generated new cluster ID: 73c357ee3c60416c8856b7f43f0d885f
I20260807 05:00:02.883496 2545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:02.902287 2545 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:02.903290 2545 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:02.915612 2545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55f645c33e7e483db1f760edef7de5fc: Generated new TSK 0
I20260807 05:00:02.916497 2545 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:00:02.935976 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:02.930840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42994 (local address 127.25.214.254:43235)
0807 05:00:02.930980 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:02.930985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:02.931147 (+ 162us) server_negotiation.cc:407] Connection header received
0807 05:00:02.931312 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:02.931315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:02.931372 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:02.931470 (+ 98us) server_negotiation.cc:226] Negotiated authn=JWT
0807 05:00:02.931703 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.932280 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.933516 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.933734 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.933833 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.934151 (+ 318us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 05:00:02.935552 (+ 1401us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41071/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 05:00:02.935797 (+ 245us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42994: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41071/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 05:00:02.936055 2527 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42994: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41071/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 05:00:02.937745 2568 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:02.930760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43235 (local address 127.0.0.1:42994)
0807 05:00:02.931059 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:02.931074 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:02.931190 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:02.931487 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:02.931490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:02.931498 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 05:00:02.931606 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:02.931613 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.932389 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.932393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:02.933386 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:02.933398 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:02.933873 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:02.933878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:02.933967 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:02.933999 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 05:00:02.935717 (+ 1718us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41071/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 05:00:02.937564 (+ 1847us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.214.254:43235: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41071/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":1641,"thread_start_us":101,"threads_started":1}
I20260807 05:00:02.938737 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 2416
E20260807 05:00:02.949620 2569 webserver.cc:533] Webserver: sslize failed:
E20260807 05:00:02.949714 2569 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T05:00:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (334 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T05:00:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:02Z Disabled control of system clock
I20260807 05:00:02.992878 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36345
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:39531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36345
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/testchainca.cert with env {}
W20260807 05:00:03.102027 2576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:03.102269 2576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:03.102306 2576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:03.106112 2576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:03.106153 2576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:03.106168 2576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:03.106182 2576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:03.106195 2576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 05:00:03.106209 2576 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 05:00:03.106221 2576 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 05:00:03.111276 2576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36345
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:03.112195 2576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:03.113107 2576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:03.121289 2589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:03.121289 2585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:03.121415 2576 server_base.cc:1034] running on GCE node
W20260807 05:00:03.121294 2592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:03.122138 2576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:03.123306 2576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:03.124481 2576 hybrid_clock.cc:648] HybridClock initialized: now 1786078803124470 us; error 38 us; skew 500 ppm
I20260807 05:00:03.126492 2576 webserver.cc:460] Webserver started at http://127.25.214.254:39983/ using document root <none> and password file <none>
I20260807 05:00:03.127087 2576 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:03.127161 2576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:03.127375 2576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:03.129726 2576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "f34bf6df51de4d7cb6f0a087469efbc4"
format_stamp: "Formatted at 2026-08-07 05:00:03 on dist-test-slave-lgr5"
server_key: "41407530ffa57e292766cabb2fdcd3c3"
server_key_iv: "cfdaab0bc0f240ac8c3073e793c60d89"
server_key_version: "encryptionkey@0"
I20260807 05:00:03.130355 2576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "f34bf6df51de4d7cb6f0a087469efbc4"
format_stamp: "Formatted at 2026-08-07 05:00:03 on dist-test-slave-lgr5"
server_key: "41407530ffa57e292766cabb2fdcd3c3"
server_key_iv: "cfdaab0bc0f240ac8c3073e793c60d89"
server_key_version: "encryptionkey@0"
I20260807 05:00:03.134541 2576 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:00:03.137100 2598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:03.138388 2576 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:03.138542 2576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "f34bf6df51de4d7cb6f0a087469efbc4"
format_stamp: "Formatted at 2026-08-07 05:00:03 on dist-test-slave-lgr5"
server_key: "41407530ffa57e292766cabb2fdcd3c3"
server_key_iv: "cfdaab0bc0f240ac8c3073e793c60d89"
server_key_version: "encryptionkey@0"
I20260807 05:00:03.138655 2576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:03.163749 2576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:03.164574 2576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:03.164774 2576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:03.172049 2576 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:36345
I20260807 05:00:03.172067 2690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:36345 every 8 connection(s)
I20260807 05:00:03.173120 2576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:03.176307 2691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:03.178778 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 2576
I20260807 05:00:03.178946 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:03.179260 26459 external_mini_cluster.cc:1428] Setting key 6b6a5f1ad58f54030d4ce09105f6f9e9
I20260807 05:00:03.182930 2691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4: Bootstrap starting.
I20260807 05:00:03.185650 2691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:03.186514 2691 log.cc:824] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:03.188953 2691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4: No bootstrap required, opened a new log
I20260807 05:00:03.189491 2700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:03.180805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44490 (local address 127.25.214.254:36345)
0807 05:00:03.181507 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:03.181525 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:03.181565 (+ 40us) server_negotiation.cc:407] Connection header received
0807 05:00:03.182247 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:03.182266 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:03.182692 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:03.182991 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:03.183445 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:03.184504 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:03.185701 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:03.186269 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:03.186416 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:03.187362 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:03.187369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:03.187386 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:03.187859 (+ 473us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:03.187926 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:03.187950 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:03.188062 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:03.188271 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 05:00:03.188584 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":138,"threads_started":1}
I20260807 05:00:03.193241 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:00:03.193509 2691 raft_consensus.cc:348] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36345 } }
I20260807 05:00:03.193782 2691 raft_consensus.cc:374] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:03.193840 2691 raft_consensus.cc:729] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f34bf6df51de4d7cb6f0a087469efbc4, State: Initialized, Role: FOLLOWER
I20260807 05:00:03.194331 2691 consensus_queue.cc:260] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36345 } }
I20260807 05:00:03.194506 2691 raft_consensus.cc:388] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:03.194579 2691 raft_consensus.cc:482] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:03.194680 2691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:03.195757 2691 raft_consensus.cc:504] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36345 } }
I20260807 05:00:03.196156 2691 leader_election.cc:302] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f34bf6df51de4d7cb6f0a087469efbc4; no voters:
I20260807 05:00:03.196511 2691 leader_election.cc:288] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:03.196651 2704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:03.196915 2704 raft_consensus.cc:686] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [term 1 LEADER]: Becoming Leader. State: Replica: f34bf6df51de4d7cb6f0a087469efbc4, State: Running, Role: LEADER
I20260807 05:00:03.197237 2704 consensus_queue.cc:237] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36345 } }
I20260807 05:00:03.197849 2691 sys_catalog.cc:564] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:03.198999 2711 sys_catalog.cc:455] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f34bf6df51de4d7cb6f0a087469efbc4. Latest consensus state: current_term: 1 leader_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36345 } } }
I20260807 05:00:03.199138 2711 sys_catalog.cc:458] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:03.199465 2705 sys_catalog.cc:455] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34bf6df51de4d7cb6f0a087469efbc4" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36345 } } }
I20260807 05:00:03.199591 2705 sys_catalog.cc:458] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:03.199530 2720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:03.202463 2720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:03.208657 2720 catalog_manager.cc:1347] Generated new cluster ID: 81302558218f4787b83b515189261b23
I20260807 05:00:03.208729 2720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:03.225178 2720 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:03.226145 2720 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:03.232617 2720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f34bf6df51de4d7cb6f0a087469efbc4: Generated new TSK 0
I20260807 05:00:03.233310 2720 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:00:03.251029 2700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:03.240929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44492 (local address 127.25.214.254:36345)
0807 05:00:03.241056 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:03.241061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:03.241258 (+ 197us) server_negotiation.cc:407] Connection header received
0807 05:00:03.241458 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:03.241461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:03.241516 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:03.241620 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0807 05:00:03.241863 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:03.242502 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:03.243523 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:03.243784 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:03.243889 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:03.244219 (+ 330us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 05:00:03.250573 (+ 6354us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 05:00:03.250863 (+ 290us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44492: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 05:00:03.251130 2700 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44492: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 05:00:03.251132 2745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:03.240853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36345 (local address 127.0.0.1:44492)
0807 05:00:03.241170 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:03.241183 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:03.241299 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:03.241627 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:03.241630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:03.241639 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 05:00:03.241750 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:03.241757 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:03.242640 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:03.242644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:03.243410 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:03.243421 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:03.243901 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:03.243905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:03.243994 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:03.244022 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 05:00:03.250788 (+ 6766us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 05:00:03.250959 (+ 171us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.214.254:36345: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":127,"threads_started":1}
I20260807 05:00:03.251763 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 2576
2026-08-07T05:00:03Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (295 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (130 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (129 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:03 dist-test-slave-lgr5 krb5kdc[2762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:03 dist-test-slave-lgr5 krb5kdc[2762](info): set up 2 sockets
Aug 07 05:00:03 dist-test-slave-lgr5 krb5kdc[2762](info): commencing operation
krb5kdc: starting...
W20260807 05:00:04.658371 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:04 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:00:04.787708 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:34377
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:34377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:04.902396 2785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:04.902679 2785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:04.902737 2785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:04.906760 2785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:04.906823 2785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:04.906849 2785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:04.906870 2785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:04.906908 2785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:04.912259 2785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:34377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:34377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:04.913354 2785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:04.914386 2785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:04.922904 2794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:04.922904 2798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:04.922902 2796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:04.922950 2785 server_base.cc:1034] running on GCE node
I20260807 05:00:04.923759 2785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:04.925035 2785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:04.926208 2785 hybrid_clock.cc:648] HybridClock initialized: now 1786078804926190 us; error 32 us; skew 500 ppm
Aug 07 05:00:04 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:04.929031 2785 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:00:04.930012 2785 webserver.cc:460] Webserver started at http://127.25.214.254:35463/ using document root <none> and password file <none>
I20260807 05:00:04.930573 2785 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:04.930642 2785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:04.930851 2785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:04.933037 2785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "d3ea80393afe47e2a59617d8502d4b6e"
format_stamp: "Formatted at 2026-08-07 05:00:04 on dist-test-slave-lgr5"
server_key: "6f61ace7d0d4b6f05f6bb570a1acbbc8"
server_key_iv: "5c0b878009187a82a62a193ef4fbb8eb"
server_key_version: "encryptionkey@0"
I20260807 05:00:04.933593 2785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "d3ea80393afe47e2a59617d8502d4b6e"
format_stamp: "Formatted at 2026-08-07 05:00:04 on dist-test-slave-lgr5"
server_key: "6f61ace7d0d4b6f05f6bb570a1acbbc8"
server_key_iv: "5c0b878009187a82a62a193ef4fbb8eb"
server_key_version: "encryptionkey@0"
I20260807 05:00:04.937423 2785 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:00:04.939860 2807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:04.941121 2785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:04.941246 2785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "d3ea80393afe47e2a59617d8502d4b6e"
format_stamp: "Formatted at 2026-08-07 05:00:04 on dist-test-slave-lgr5"
server_key: "6f61ace7d0d4b6f05f6bb570a1acbbc8"
server_key_iv: "5c0b878009187a82a62a193ef4fbb8eb"
server_key_version: "encryptionkey@0"
I20260807 05:00:04.941346 2785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:04.952744 2785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:04.955567 2785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:04.955747 2785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:04.962491 2785 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:34377
I20260807 05:00:04.962568 2887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:34377 every 8 connection(s)
I20260807 05:00:04.963469 2785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:04.964279 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 2785
I20260807 05:00:04.964393 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:04.964661 26459 external_mini_cluster.cc:1428] Setting key 454b86cdfafe9cda75419f5a8b8691e2
I20260807 05:00:04.966660 2888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:04.973505 2888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e: Bootstrap starting.
Aug 07 05:00:04 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:04.976143 2888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:04.977070 2888 log.cc:824] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:04.979146 2888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e: No bootstrap required, opened a new log
I20260807 05:00:04.979768 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:04.966039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33646 (local address 127.25.214.254:34377)
0807 05:00:04.966458 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:04.966476 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:04.966520 (+ 44us) server_negotiation.cc:407] Connection header received
0807 05:00:04.967372 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:04.967396 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:04.967790 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:04.968194 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:04.969009 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:04.970469 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:04.971442 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:04.972148 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:04.972309 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:04.974770 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:04.974777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:04.974793 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:04.974827 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:04.976830 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:04.977321 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:04.977326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:04.977331 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:04.977472 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:04.977741 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:04.977744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:04.977745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:04.978170 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:04.978359 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:04.978659 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 05:00:04.978955 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":109,"threads_started":1}
I20260807 05:00:04.983194 2888 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ea80393afe47e2a59617d8502d4b6e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 34377 } }
I20260807 05:00:04.983453 2888 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:04.983515 2888 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ea80393afe47e2a59617d8502d4b6e, State: Initialized, Role: FOLLOWER
I20260807 05:00:04.983927 2888 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ea80393afe47e2a59617d8502d4b6e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 34377 } }
I20260807 05:00:04.984059 2888 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:04.984146 2888 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:04.984251 2888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:04.985231 2888 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ea80393afe47e2a59617d8502d4b6e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 34377 } }
I20260807 05:00:04.985594 2888 leader_election.cc:302] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3ea80393afe47e2a59617d8502d4b6e; no voters:
I20260807 05:00:04.985961 2888 leader_election.cc:288] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:04.986094 2897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:04.986342 2897 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [term 1 LEADER]: Becoming Leader. State: Replica: d3ea80393afe47e2a59617d8502d4b6e, State: Running, Role: LEADER
I20260807 05:00:04.986688 2897 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ea80393afe47e2a59617d8502d4b6e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 34377 } }
I20260807 05:00:04.987250 2888 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:04.988318 2898 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3ea80393afe47e2a59617d8502d4b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ea80393afe47e2a59617d8502d4b6e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 34377 } } }
I20260807 05:00:04.988463 2898 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:04.988755 2899 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3ea80393afe47e2a59617d8502d4b6e. Latest consensus state: current_term: 1 leader_uuid: "d3ea80393afe47e2a59617d8502d4b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ea80393afe47e2a59617d8502d4b6e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 34377 } } }
I20260807 05:00:04.988852 2899 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:04.988948 2911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:04.992187 2911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:04.997597 2911 catalog_manager.cc:1347] Generated new cluster ID: 3c8119e8037247139646e99c6be61c9c
I20260807 05:00:04.997673 2911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:05.015002 2911 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:05.016270 2911 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:05.024626 2911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3ea80393afe47e2a59617d8502d4b6e: Generated new TSK 0
I20260807 05:00:05.025364 2911 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:00:05.065143 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:34377
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:05.179203 2934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:05.179476 2934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:05.179533 2934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:05.183539 2934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:05.183604 2934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:05.183684 2934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:05.189083 2934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:05.190244 2934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:05.191308 2934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:05.201287 2945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:05.201279 2941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:05.201506 2934 server_base.cc:1034] running on GCE node
W20260807 05:00:05.201279 2942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:05.202060 2934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:05.202751 2934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:05.203920 2934 hybrid_clock.cc:648] HybridClock initialized: now 1786078805203901 us; error 31 us; skew 500 ppm
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.206768 2934 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:00:05.207973 2934 webserver.cc:460] Webserver started at http://127.25.214.193:36967/ using document root <none> and password file <none>
I20260807 05:00:05.208593 2934 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:05.208663 2934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:05.208884 2934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:05.211078 2934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "3dad8681cde14ccba59705bc10c05aaf"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "47fb71d9c26ae08ea9008771fa3274b5"
server_key_iv: "c80f7f0b27e66d2a2401270a36f40878"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.211647 2934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "3dad8681cde14ccba59705bc10c05aaf"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "47fb71d9c26ae08ea9008771fa3274b5"
server_key_iv: "c80f7f0b27e66d2a2401270a36f40878"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.215576 2934 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 05:00:05.218104 2954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.219305 2934 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:05.219436 2934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "3dad8681cde14ccba59705bc10c05aaf"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "47fb71d9c26ae08ea9008771fa3274b5"
server_key_iv: "c80f7f0b27e66d2a2401270a36f40878"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.219542 2934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:05.240440 2934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:05.243317 2934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:05.243501 2934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:05.244155 2934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:05.245038 2934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:05.245085 2934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.245141 2934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:05.245165 2934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.253535 2934 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:43109
I20260807 05:00:05.253566 3139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:43109 every 8 connection(s)
I20260807 05:00:05.254424 2934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:05.262521 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 2934
I20260807 05:00:05.262634 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:05.262905 26459 external_mini_cluster.cc:1428] Setting key 6dd15bf3e840caa4832aad5bd0185e9f
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:05.267783 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.256194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:41209 (local address 127.25.214.254:34377)
0807 05:00:05.256347 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.256352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.257213 (+ 861us) server_negotiation.cc:407] Connection header received
0807 05:00:05.258534 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.258537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.258583 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.258654 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.259754 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.260326 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.261386 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.261607 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.261683 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.264195 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:05.264199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:05.264202 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:05.264226 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:05.265644 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.266245 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.266249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.266251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.266351 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.266655 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.266657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.266659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.266882 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:05.266989 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:05.267504 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 05:00:05.267629 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:00:05.268800 3144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.256619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:34377 (local address 127.25.214.193:41209)
0807 05:00:05.257064 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:05.257110 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:05.258333 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:05.258803 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:05.258810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:05.259153 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:05.259642 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:05.259655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.260416 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.260430 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:05.261287 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:05.261296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.261722 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.261725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:05.261862 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.262478 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:05.262502 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:05.264023 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:05.265765 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:05.265772 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:05.265788 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:05.266125 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:05.266440 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:05.266442 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:05.266443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:05.266575 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:05.267014 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:05.267020 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:05.267267 (+ 247us) client_negotiation.cc:769] Sending connection context
0807 05:00:05.267435 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 05:00:05.267749 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
I20260807 05:00:05.270088 3140 heartbeater.cc:347] Connected to a master server at 127.25.214.254:34377
I20260807 05:00:05.270324 3140 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:05.270814 3140 heartbeater.cc:511] Master 127.25.214.254:34377 requested a full tablet report, sending...
I20260807 05:00:05.272383 2839 ts_manager.cc:194] Registered new tserver with Master: 3dad8681cde14ccba59705bc10c05aaf (127.25.214.193:43109)
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:00:05.273559 2839 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:41209
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:00:05.291290 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:34377
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:05.408883 3150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:05.409174 3150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:05.409224 3150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:05.413316 3150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:05.413379 3150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:05.413452 3150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:05.418936 3150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:05.420212 3150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:05.421320 3150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:05.431049 3160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:05.431056 3165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:05.431067 3162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:05.431216 3150 server_base.cc:1034] running on GCE node
I20260807 05:00:05.431746 3150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:05.432425 3150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:05.433581 3150 hybrid_clock.cc:648] HybridClock initialized: now 1786078805433564 us; error 27 us; skew 500 ppm
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.436272 3150 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:00:05.437116 3150 webserver.cc:460] Webserver started at http://127.25.214.194:43925/ using document root <none> and password file <none>
I20260807 05:00:05.437676 3150 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:05.437744 3150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:05.437947 3150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:05.440018 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "eae94db9805f46df9734634b30e9a596"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "1b02cfe70df64e00fe226c0b9c9c7cf3"
server_key_iv: "be97a307ce0f76dcb1a2d3d3935689f4"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.440595 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "eae94db9805f46df9734634b30e9a596"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "1b02cfe70df64e00fe226c0b9c9c7cf3"
server_key_iv: "be97a307ce0f76dcb1a2d3d3935689f4"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.444178 3150 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:00:05.446524 3173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.447659 3150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:05.447767 3150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "eae94db9805f46df9734634b30e9a596"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "1b02cfe70df64e00fe226c0b9c9c7cf3"
server_key_iv: "be97a307ce0f76dcb1a2d3d3935689f4"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.447863 3150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:05.482164 3150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:05.485350 3150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:05.485538 3150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:05.486148 3150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:05.487020 3150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:05.487067 3150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.487123 3150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:05.487146 3150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.495936 3150 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:33727
I20260807 05:00:05.495963 3360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:33727 every 8 connection(s)
I20260807 05:00:05.496882 3150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:05.498747 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 3150
I20260807 05:00:05.498854 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:05.499164 26459 external_mini_cluster.cc:1428] Setting key 3128e5cd27dc642ad4084621b6b656d9
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:00:05.511281 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.498729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:33323 (local address 127.25.214.254:34377)
0807 05:00:05.498899 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.498904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.499781 (+ 877us) server_negotiation.cc:407] Connection header received
0807 05:00:05.501262 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.501265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.501320 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.501408 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.502549 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.503157 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.504351 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.504583 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.504675 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.507574 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:05.507578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:05.507580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:05.507608 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:05.509061 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.509685 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.509687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.509688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.509767 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.510211 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.510214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.510216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.510416 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:05.510498 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:05.511008 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 05:00:05.511130 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 05:00:05.512454 3367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.499130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:34377 (local address 127.25.214.194:33323)
0807 05:00:05.499626 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:05.499681 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:05.501051 (+ 1370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:05.501554 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:05.501561 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:05.501904 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:05.502399 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:05.502413 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.503283 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.503286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:05.504238 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:05.504248 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.504729 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.504733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:05.504926 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.505591 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:05.505610 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:05.507355 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:05.509237 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:05.509246 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:05.509269 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:05.509593 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:05.509883 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:05.509886 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:05.509887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:05.510114 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:05.510517 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:05.510523 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:05.510805 (+ 282us) client_negotiation.cc:769] Sending connection context
0807 05:00:05.510977 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 05:00:05.511348 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":125,"threads_started":1}
I20260807 05:00:05.513721 3363 heartbeater.cc:347] Connected to a master server at 127.25.214.254:34377
I20260807 05:00:05.513970 3363 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:05.514494 3363 heartbeater.cc:511] Master 127.25.214.254:34377 requested a full tablet report, sending...
I20260807 05:00:05.515625 2839 ts_manager.cc:194] Registered new tserver with Master: eae94db9805f46df9734634b30e9a596 (127.25.214.194:33727)
I20260807 05:00:05.516391 2839 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:33323
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:00:05.529402 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:34377
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:05.643477 3370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:05.643764 3370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:05.643808 3370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:05.647954 3370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:05.648025 3370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:05.648108 3370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:05.653445 3370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:05.654465 3370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:05.655460 3370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:00:05.664783 3370 server_base.cc:1034] running on GCE node
W20260807 05:00:05.664737 3380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:05.664816 3385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:05.664816 3383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:05.665382 3370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:05.665980 3370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:05.667141 3370 hybrid_clock.cc:648] HybridClock initialized: now 1786078805667116 us; error 36 us; skew 500 ppm
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.669847 3370 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:00:05.670753 3370 webserver.cc:460] Webserver started at http://127.25.214.195:41165/ using document root <none> and password file <none>
I20260807 05:00:05.671317 3370 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:05.671389 3370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:05.671624 3370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:05.673755 3370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "6e4dc642899746fa8e450945c0911b24"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "8c03a3f496110db1bbb36573b39a67fc"
server_key_iv: "54b89c4f26d23ff1dbf8cfd593f42014"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.674293 3370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "6e4dc642899746fa8e450945c0911b24"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "8c03a3f496110db1bbb36573b39a67fc"
server_key_iv: "54b89c4f26d23ff1dbf8cfd593f42014"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.678133 3370 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 05:00:05.680620 3396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.681892 3370 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:05.682022 3370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "6e4dc642899746fa8e450945c0911b24"
format_stamp: "Formatted at 2026-08-07 05:00:05 on dist-test-slave-lgr5"
server_key: "8c03a3f496110db1bbb36573b39a67fc"
server_key_iv: "54b89c4f26d23ff1dbf8cfd593f42014"
server_key_version: "encryptionkey@0"
I20260807 05:00:05.682153 3370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:05.711887 3370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:05.715605 3370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:05.715826 3370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:05.716547 3370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:05.717515 3370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:05.717573 3370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.717633 3370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:05.717662 3370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:05.727101 3370 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:45481
I20260807 05:00:05.727128 3576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:45481 every 8 connection(s)
I20260807 05:00:05.728062 3370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:05.737031 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 3370
I20260807 05:00:05.737181 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:05.737471 26459 external_mini_cluster.cc:1428] Setting key a62989debc3b279b91994f5999b04dd6
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:05.741994 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.729931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:53681 (local address 127.25.214.254:34377)
0807 05:00:05.730069 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.730073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.730947 (+ 874us) server_negotiation.cc:407] Connection header received
0807 05:00:05.732390 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.732394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.732455 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.732531 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.733736 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.734274 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.735412 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.735632 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.735720 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.738503 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:05.738507 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:05.738510 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:05.738539 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:05.740059 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.740603 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.740607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.740608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.740682 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.741001 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.741003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.741004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.741192 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:05.741265 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:05.741772 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 05:00:05.741871 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:00:05.742857 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.730303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:34377 (local address 127.25.214.195:53681)
0807 05:00:05.730787 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:05.730833 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:05.732174 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:05.732717 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:05.732724 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:05.733097 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:05.733588 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:05.733601 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.734398 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.734401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:05.735292 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:05.735301 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.735777 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.735780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:05.735938 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.736555 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:05.736571 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:05.738322 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:05.740204 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:05.740209 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:05.740222 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:05.740515 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:05.740754 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:05.740757 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:05.740759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:05.740922 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:05.741285 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:05.741291 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:05.741570 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 05:00:05.741744 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 05:00:05.742012 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":126,"threads_started":1}
I20260807 05:00:05.743942 3578 heartbeater.cc:347] Connected to a master server at 127.25.214.254:34377
I20260807 05:00:05.744232 3578 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:05.744817 3578 heartbeater.cc:511] Master 127.25.214.254:34377 requested a full tablet report, sending...
I20260807 05:00:05.745934 2839 ts_manager.cc:194] Registered new tserver with Master: 6e4dc642899746fa8e450945c0911b24 (127.25.214.195:45481)
I20260807 05:00:05.746502 2839 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:53681
I20260807 05:00:05.751504 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/test-admin.keytab.
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.768735 26459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 05:00:05.771451 3589 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:05.770145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.25.214.193:43109)
0807 05:00:05.770433 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.770442 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.770470 (+ 28us) server_negotiation.cc:407] Connection header received
0807 05:00:05.770524 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.770528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.770714 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.770831 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.771282 (+ 451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35824: BlockingRecv error: recv got EOF from 127.0.0.1:35824 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":105,"threads_started":1}
W20260807 05:00:05.771680 26459 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc)
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.772704 26459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.773804 26459 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 05:00:05.783985 3589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.774988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35830 (local address 127.25.214.193:43109)
0807 05:00:05.775162 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.775167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.775277 (+ 110us) server_negotiation.cc:407] Connection header received
0807 05:00:05.775441 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.775444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.775494 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.775567 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.776191 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.777012 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.777842 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.778234 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.778330 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.780519 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:05.780532 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:05.780547 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:05.780573 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:05.782102 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.782571 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.782578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.782579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.782665 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.782938 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.782942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.782944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.783219 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:05.783458 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:05.783638 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 05:00:05.783815 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260807 05:00:05.788039 3589 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:05.787003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.25.214.193:43109)
0807 05:00:05.787148 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.787152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.787286 (+ 134us) server_negotiation.cc:407] Connection header received
0807 05:00:05.787417 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.787419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.787458 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.787522 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.787928 (+ 406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35838: BlockingRecv error: recv got EOF from 127.0.0.1:35838 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 05:00:05.788272 26459 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc)
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.789320 26459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.790158 26459 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 05:00:05.798738 3589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.790993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35854 (local address 127.25.214.193:43109)
0807 05:00:05.791108 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.791113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.791190 (+ 77us) server_negotiation.cc:407] Connection header received
0807 05:00:05.791327 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.791330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.791372 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.791438 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.791930 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.792503 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.793270 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.793514 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.793602 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.795837 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:05.795841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:05.795843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:05.795875 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:05.797124 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.797568 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.797572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.797573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.797653 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.797907 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.797911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.797913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.798090 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:05.798236 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:05.798460 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 05:00:05.798577 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 05:00:05.801779 3589 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:05.800833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35866 (local address 127.25.214.193:43109)
0807 05:00:05.800990 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.800994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.801036 (+ 42us) server_negotiation.cc:407] Connection header received
0807 05:00:05.801150 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.801152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.801193 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.801260 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.801653 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35866: BlockingRecv error: recv got EOF from 127.0.0.1:35866 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 05:00:05.801914 26459 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786078774062608-26459-0/krb5kdc/krb5cc' of type FILE
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.802994 26459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:05.803872 26459 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[2762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 05:00:05.812279 3589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:05.804798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35882 (local address 127.25.214.193:43109)
0807 05:00:05.804926 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:05.804930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:05.805026 (+ 96us) server_negotiation.cc:407] Connection header received
0807 05:00:05.805131 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:05.805134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:05.805175 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:05.805242 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:05.805739 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.806231 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.806972 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:05.807173 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:05.807237 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:05.809434 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:05.809438 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:05.809439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:05.809464 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:05.810716 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.811117 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.811120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.811121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.811195 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:05.811451 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:05.811455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:05.811456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:05.811626 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:05.811764 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:05.811983 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 05:00:05.812127 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:00:05.813397 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 2934
I20260807 05:00:05.827706 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 3150
I20260807 05:00:05.842568 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 3370
I20260807 05:00:05.870107 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 2785
2026-08-07T05:00:05Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2361 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[3613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[3613](info): set up 2 sockets
Aug 07 05:00:05 dist-test-slave-lgr5 krb5kdc[3613](info): commencing operation
krb5kdc: starting...
W20260807 05:00:07.046918 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab.
Entry for principal oryx/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab.
I20260807 05:00:07.179788 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:38261
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab
--principal=oryx/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:38261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:07.297322 3639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:07.297668 3639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:07.297712 3639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:07.302008 3639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:07.302094 3639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:07.302114 3639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:07.302129 3639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:07.302143 3639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:07.308193 3639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:38261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab
--principal=oryx/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:38261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:07.309468 3639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:07.310591 3639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:07.319753 3646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:07.319782 3647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:07.319768 3649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:07.320124 3639 server_base.cc:1034] running on GCE node
I20260807 05:00:07.320742 3639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:07.321894 3639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:07.323066 3639 hybrid_clock.cc:648] HybridClock initialized: now 1786078807323051 us; error 28 us; skew 500 ppm
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:07.325749 3639 init.cc:377] Logged in from keytab as oryx/127.25.214.254@KRBTEST.COM (short username oryx)
I20260807 05:00:07.326648 3639 webserver.cc:460] Webserver started at http://127.25.214.254:34227/ using document root <none> and password file <none>
I20260807 05:00:07.327203 3639 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:07.327263 3639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:07.327461 3639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:07.329568 3639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "14c8825ad0e242998179be6717077459"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "a31217cf07539ba113ab1c5f0219a2e2"
server_key_iv: "104b43682f542594bfd9f47de6040fa5"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.330123 3639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "14c8825ad0e242998179be6717077459"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "a31217cf07539ba113ab1c5f0219a2e2"
server_key_iv: "104b43682f542594bfd9f47de6040fa5"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.333796 3639 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 05:00:07.336226 3658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.337471 3639 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:07.337584 3639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "14c8825ad0e242998179be6717077459"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "a31217cf07539ba113ab1c5f0219a2e2"
server_key_iv: "104b43682f542594bfd9f47de6040fa5"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.337703 3639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:07.364703 3639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:07.367797 3639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:07.367985 3639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:07.375229 3639 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:38261
I20260807 05:00:07.375512 3746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:38261 every 8 connection(s)
I20260807 05:00:07.376380 3639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:07.377447 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 3639
I20260807 05:00:07.377578 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:07.377895 26459 external_mini_cluster.cc:1428] Setting key 89383de52d79b18b39813675283388c8
I20260807 05:00:07.379971 3750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:07.386988 3750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Bootstrap starting.
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:07.389755 3750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:07.390650 3750 log.cc:824] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:07.392841 3750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: No bootstrap required, opened a new log
I20260807 05:00:07.392927 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:07.379441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60354 (local address 127.25.214.254:38261)
0807 05:00:07.379909 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:07.379929 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:07.379975 (+ 46us) server_negotiation.cc:407] Connection header received
0807 05:00:07.380875 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:07.380897 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:07.381312 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:07.381697 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:07.382379 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.383887 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.384804 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.385500 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.385665 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:07.388066 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:07.388073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:07.388116 (+ 43us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:07.388153 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:07.390045 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:07.390472 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:07.390477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:07.390484 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:07.390627 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:07.390886 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:07.390889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:07.390890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:07.391340 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:07.391549 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:07.391834 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 05:00:07.392172 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":134,"threads_started":1}
I20260807 05:00:07.396708 3750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } }
I20260807 05:00:07.396978 3750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:07.397033 3750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c8825ad0e242998179be6717077459, State: Initialized, Role: FOLLOWER
I20260807 05:00:07.397449 3750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } }
I20260807 05:00:07.397590 3750 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:07.397657 3750 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:07.397758 3750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:07.398881 3750 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } }
I20260807 05:00:07.399240 3750 leader_election.cc:302] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14c8825ad0e242998179be6717077459; no voters:
I20260807 05:00:07.399557 3750 leader_election.cc:288] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:07.399744 3757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:07.400051 3757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 LEADER]: Becoming Leader. State: Replica: 14c8825ad0e242998179be6717077459, State: Running, Role: LEADER
I20260807 05:00:07.400416 3757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } }
I20260807 05:00:07.400877 3750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:07.402036 3760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14c8825ad0e242998179be6717077459. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } }
I20260807 05:00:07.402168 3760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:07.402568 3779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:07.402593 3759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } }
I20260807 05:00:07.402760 3759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:07.406322 3779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:07.413079 3779 catalog_manager.cc:1347] Generated new cluster ID: 58ec4e9a9dd6469e87fe9651cbf2c408
I20260807 05:00:07.413229 3779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:07.422109 3779 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:07.423053 3779 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:07.429934 3779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Generated new TSK 0
I20260807 05:00:07.430598 3779 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab.
Entry for principal oryx/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab.
I20260807 05:00:07.464885 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38261
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:07.582405 3798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:07.582669 3798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:07.582711 3798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:07.586611 3798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:07.586660 3798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:07.586714 3798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:07.591784 3798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:07.592796 3798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:07.593753 3798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:07.603304 3807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:07.603364 3798 server_base.cc:1034] running on GCE node
W20260807 05:00:07.603312 3808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:07.603533 3810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:07.603978 3798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:07.604679 3798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:07.605836 3798 hybrid_clock.cc:648] HybridClock initialized: now 1786078807605814 us; error 35 us; skew 500 ppm
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:07.608533 3798 init.cc:377] Logged in from keytab as oryx/127.25.214.193@KRBTEST.COM (short username oryx)
I20260807 05:00:07.609354 3798 webserver.cc:460] Webserver started at http://127.25.214.193:37175/ using document root <none> and password file <none>
I20260807 05:00:07.609894 3798 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:07.609962 3798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:07.610164 3798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:07.612211 3798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "cf646928cfe64bb18210d3a1d9221af6"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "532925bd137d95f57dadbccdeee7476f"
server_key_iv: "a856bb1e0ce4e554c14e9fc41fcf41b5"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.612840 3798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "cf646928cfe64bb18210d3a1d9221af6"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "532925bd137d95f57dadbccdeee7476f"
server_key_iv: "a856bb1e0ce4e554c14e9fc41fcf41b5"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.616446 3798 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:00:07.618731 3819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.619889 3798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:07.619997 3798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "cf646928cfe64bb18210d3a1d9221af6"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "532925bd137d95f57dadbccdeee7476f"
server_key_iv: "a856bb1e0ce4e554c14e9fc41fcf41b5"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.620113 3798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:07.652029 3798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:07.655349 3798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:07.655541 3798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:07.656188 3798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:07.657133 3798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:07.657187 3798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.657231 3798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:07.657250 3798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.666702 3798 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:44367
I20260807 05:00:07.666734 3997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:44367 every 8 connection(s)
I20260807 05:00:07.667707 3798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:07.672768 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 3798
I20260807 05:00:07.672915 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:07.673243 26459 external_mini_cluster.cc:1428] Setting key 79030f973957bfdf578796e7c4cd6d45
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:07.682183 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:07.669637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:48803 (local address 127.25.214.254:38261)
0807 05:00:07.669777 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:07.669780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:07.670638 (+ 858us) server_negotiation.cc:407] Connection header received
0807 05:00:07.672041 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:07.672044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:07.672127 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:07.672203 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:07.673773 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.674436 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.675648 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.675879 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.675984 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:07.678624 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:07.678628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:07.678630 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:07.678655 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:07.679998 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:07.680566 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:07.680569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:07.680571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:07.680651 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:07.680988 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:07.680991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:07.680993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:07.681189 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:07.681278 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:07.681834 (+ 556us) server_negotiation.cc:299] Negotiation successful
0807 05:00:07.681997 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for oryx/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:00:07.683162 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:07.670016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:48803)
0807 05:00:07.670484 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:07.670528 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:07.671813 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:07.672404 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:07.672411 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:07.672914 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:07.673616 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:07.673638 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.674575 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.674578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:07.675517 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:07.675528 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.676029 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.676033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:07.676230 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:07.676831 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:07.676848 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:07.678449 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:07.680147 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:07.680154 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:07.680174 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:07.680464 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:07.680736 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:07.680739 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:07.680741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:07.680895 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:07.681296 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:07.681304 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:07.681590 (+ 286us) client_negotiation.cc:769] Sending connection context
0807 05:00:07.681774 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 05:00:07.682157 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":108,"threads_started":1}
I20260807 05:00:07.684754 3999 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38261
I20260807 05:00:07.685055 3999 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:07.685702 3999 heartbeater.cc:511] Master 127.25.214.254:38261 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.194@KRBTEST.COM" created.
I20260807 05:00:07.687609 3690 ts_manager.cc:194] Registered new tserver with Master: cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367)
I20260807 05:00:07.688957 3690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:48803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab.
Entry for principal oryx/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab.
I20260807 05:00:07.704205 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38261
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:07.822067 4005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:07.822361 4005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:07.822438 4005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:07.826558 4005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:07.826646 4005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:07.826736 4005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:07.832424 4005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:07.833585 4005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:07.834630 4005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:07.844408 4014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:07.844375 4012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:07.844353 4016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:07.844457 4005 server_base.cc:1034] running on GCE node
I20260807 05:00:07.845027 4005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:07.845628 4005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:07.846819 4005 hybrid_clock.cc:648] HybridClock initialized: now 1786078807846801 us; error 28 us; skew 500 ppm
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:07.849515 4005 init.cc:377] Logged in from keytab as oryx/127.25.214.194@KRBTEST.COM (short username oryx)
I20260807 05:00:07.850329 4005 webserver.cc:460] Webserver started at http://127.25.214.194:36673/ using document root <none> and password file <none>
I20260807 05:00:07.850848 4005 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:07.850919 4005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:07.851125 4005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:07.853156 4005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "8f5de97a55004698805a2274c682e9bb"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "27487657bb887bb5d3ee2bbc34a2a2a9"
server_key_iv: "a1078409a2c6decdd60bbb8f30a96591"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.853680 4005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "8f5de97a55004698805a2274c682e9bb"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "27487657bb887bb5d3ee2bbc34a2a2a9"
server_key_iv: "a1078409a2c6decdd60bbb8f30a96591"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.857288 4005 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:00:07.859597 4033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.860797 4005 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:07.860926 4005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "8f5de97a55004698805a2274c682e9bb"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "27487657bb887bb5d3ee2bbc34a2a2a9"
server_key_iv: "a1078409a2c6decdd60bbb8f30a96591"
server_key_version: "encryptionkey@0"
I20260807 05:00:07.861020 4005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:07.873044 4005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:07.875985 4005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:07.876176 4005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:07.876711 4005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:07.877512 4005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:07.877558 4005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.877595 4005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:07.877615 4005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:07.887940 4005 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:40341
I20260807 05:00:07.888002 4209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:40341 every 8 connection(s)
I20260807 05:00:07.888815 4005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:07.892645 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 4005
I20260807 05:00:07.892742 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:07.893005 26459 external_mini_cluster.cc:1428] Setting key 0d625c7d91a2519ff9c401961e888883
Aug 07 05:00:07 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:07.903776 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:07.890612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:43721 (local address 127.25.214.254:38261)
0807 05:00:07.890747 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:07.890751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:07.891559 (+ 808us) server_negotiation.cc:407] Connection header received
0807 05:00:07.892978 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:07.892982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:07.893039 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:07.893108 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:07.894330 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.894841 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.896492 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.896884 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.897018 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:07.899800 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:07.899804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:07.899806 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:07.899831 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:07.901302 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:07.901948 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:07.901951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:07.901952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:07.902038 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:07.902533 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:07.902535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:07.902536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:07.902717 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:07.902796 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:07.903536 (+ 740us) server_negotiation.cc:299] Negotiation successful
0807 05:00:07.903645 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
WARNING: no policy specified for oryx/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:00:07.904904 4216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:07.890949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:43721)
0807 05:00:07.891407 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:07.891447 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:07.892759 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:07.893336 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:07.893345 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:07.893716 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:07.894189 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:07.894202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.894964 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.894967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:07.896306 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:07.896320 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:07.897076 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:07.897079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:07.897259 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:07.897948 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:07.897966 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:07.899603 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:07.901422 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:07.901428 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:07.901447 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:07.901838 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:07.902132 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:07.902135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:07.902137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:07.902431 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:07.902836 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:07.902844 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:07.903221 (+ 377us) client_negotiation.cc:769] Sending connection context
0807 05:00:07.903469 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 05:00:07.903865 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":126,"threads_started":1}
I20260807 05:00:07.906088 4210 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38261
I20260807 05:00:07.906343 4210 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.195@KRBTEST.COM" created.
I20260807 05:00:07.906886 4210 heartbeater.cc:511] Master 127.25.214.254:38261 requested a full tablet report, sending...
I20260807 05:00:07.908054 3690 ts_manager.cc:194] Registered new tserver with Master: 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:07.908843 3690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:43721
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab.
Entry for principal oryx/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab.
I20260807 05:00:07.921238 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38261
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:08.034458 4222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:08.034716 4222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:08.034775 4222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:08.038699 4222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:08.038754 4222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:08.038831 4222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:08.044245 4222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:08.045440 4222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:08.046424 4222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:08.055994 4229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.056041 4231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.055981 4228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.056300 4222 server_base.cc:1034] running on GCE node
I20260807 05:00:08.056718 4222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:08.057358 4222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:08.058543 4222 hybrid_clock.cc:648] HybridClock initialized: now 1786078808058516 us; error 38 us; skew 500 ppm
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:08.061173 4222 init.cc:377] Logged in from keytab as oryx/127.25.214.195@KRBTEST.COM (short username oryx)
I20260807 05:00:08.062050 4222 webserver.cc:460] Webserver started at http://127.25.214.195:34837/ using document root <none> and password file <none>
I20260807 05:00:08.062592 4222 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.062656 4222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.062870 4222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:08.064971 4222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "5585fc20ee6d46988a9665b0327a34d7"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "51a26791cbb18ca54871363f8f98cfa2"
server_key_iv: "d4fb8062b4190fe802a6f1fe0585efb0"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.065510 4222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "5585fc20ee6d46988a9665b0327a34d7"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "51a26791cbb18ca54871363f8f98cfa2"
server_key_iv: "d4fb8062b4190fe802a6f1fe0585efb0"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.069033 4222 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 05:00:08.071280 4242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.072516 4222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:08.072623 4222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "5585fc20ee6d46988a9665b0327a34d7"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "51a26791cbb18ca54871363f8f98cfa2"
server_key_iv: "d4fb8062b4190fe802a6f1fe0585efb0"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.072712 4222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.098182 4222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:08.101078 4222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:08.101258 4222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:08.101912 4222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:08.102770 4222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:08.102835 4222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.102900 4222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:08.102928 4222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.111558 4222 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:42217
I20260807 05:00:08.111586 4432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:42217 every 8 connection(s)
I20260807 05:00:08.112439 4222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:08.117457 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 4222
I20260807 05:00:08.117559 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:08.117807 26459 external_mini_cluster.cc:1428] Setting key 7b884dbbe19ba68f625b1c15a5b2e588
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:08.125759 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.114125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:38327 (local address 127.25.214.254:38261)
0807 05:00:08.114290 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.114294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.115133 (+ 839us) server_negotiation.cc:407] Connection header received
0807 05:00:08.116498 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.116501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.116558 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.116628 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.117786 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.118417 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.119681 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.119890 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.119976 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.122267 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.122270 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.122272 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.122296 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.123666 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.124258 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.124262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.124264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.124369 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.124710 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.124713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.124714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.124892 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.124978 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.125488 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.125608 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 05:00:08.126524 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.114469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:38327)
0807 05:00:08.114960 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.115013 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.116285 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.116802 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.116809 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.117155 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.117649 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.117666 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.118534 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.118537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.119562 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.119572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.120030 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.120034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.120217 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.120727 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.120743 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.122119 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.123767 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.123773 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.123786 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.124038 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.124468 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.124471 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.124473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.124609 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.124992 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.124998 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.125212 (+ 214us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.125359 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.125647 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":148,"threads_started":1}
I20260807 05:00:08.127526 4435 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38261
I20260807 05:00:08.127733 4435 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:08.128212 4435 heartbeater.cc:511] Master 127.25.214.254:38261 requested a full tablet report, sending...
I20260807 05:00:08.129194 3690 ts_manager.cc:194] Registered new tserver with Master: 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217)
I20260807 05:00:08.129714 3690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:38327
I20260807 05:00:08.131341 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.214.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.253.keytab.
Entry for principal oryx/127.25.214.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.253.keytab.
I20260807 05:00:08.157251 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:40677
--webserver_interface=127.25.214.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.253.keytab
--principal=oryx/127.25.214.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:38261,127.25.214.253:40677
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:08.266727 4441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:08.266968 4441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:08.267005 4441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:08.270879 4441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:08.270927 4441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:08.270946 4441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:08.270959 4441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:08.270972 4441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:08.275961 4441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:38261,127.25.214.253:40677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.253.keytab
--principal=oryx/127.25.214.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.214.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
W20260807 05:00:08.276167 4441 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.25.214.254:38261,127.25.214.253:40677'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 05:00:08.276978 4441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:08.277900 4441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:08.285979 4452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.285981 4453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.286144 4441 server_base.cc:1034] running on GCE node
W20260807 05:00:08.286331 4456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.286880 4441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:08.287892 4441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:08.289050 4441 hybrid_clock.cc:648] HybridClock initialized: now 1786078808289020 us; error 43 us; skew 500 ppm
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:08.291718 4441 init.cc:377] Logged in from keytab as oryx/127.25.214.253@KRBTEST.COM (short username oryx)
I20260807 05:00:08.292606 4441 webserver.cc:460] Webserver started at http://127.25.214.253:35139/ using document root <none> and password file <none>
I20260807 05:00:08.293114 4441 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.293171 4441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.293332 4441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:08.295282 4441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/instance:
uuid: "170c6ff09b204c67af5ee2778565c3cf"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "40240e9eab5ac007a424b3941b8662ee"
server_key_iv: "1af553381bd14db18b755a91882d8df4"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.295836 4441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal/instance:
uuid: "170c6ff09b204c67af5ee2778565c3cf"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "40240e9eab5ac007a424b3941b8662ee"
server_key_iv: "1af553381bd14db18b755a91882d8df4"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.299587 4441 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:00:08.302168 4473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.303354 4441 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:08.303475 4441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
uuid: "170c6ff09b204c67af5ee2778565c3cf"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "40240e9eab5ac007a424b3941b8662ee"
server_key_iv: "1af553381bd14db18b755a91882d8df4"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.303573 4441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.314508 4441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:08.317119 4441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:08.317318 4441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:08.324520 4441 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.253:40677
I20260807 05:00:08.324790 4556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.253:40677 every 8 connection(s)
I20260807 05:00:08.325562 4441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
I20260807 05:00:08.328308 4557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:08.332237 4557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:00:08.333036 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 4441
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.253@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:08.346014 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.334334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60370 (local address 127.25.214.254:38261)
0807 05:00:08.334476 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.334481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.335171 (+ 690us) server_negotiation.cc:407] Connection header received
0807 05:00:08.335823 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.335826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.335885 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.335990 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.337040 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.337845 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.339194 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.339545 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.339653 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.342321 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.342325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.342328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.342361 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.343712 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.344301 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.344304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.344305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.344379 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.344719 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.344723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.344724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.344993 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.345094 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.345697 (+ 603us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.345825 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 05:00:08.347021 4562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.334509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:60370)
0807 05:00:08.335011 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.335058 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.335636 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.336025 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.336034 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.336532 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.336883 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.336916 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.337969 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.337972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.339069 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.339080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.339684 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.339686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.339812 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.340412 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.340433 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.342158 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.343815 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.343823 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.343832 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.344213 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.344454 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.344457 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.344460 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.344612 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.345094 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.345099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.345453 (+ 354us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.345619 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.345948 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"spinlock_wait_cycles":5760,"thread_start_us":159,"threads_started":1}
I20260807 05:00:08.347021 4561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.334509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58362 (local address 127.25.214.253:40677)
0807 05:00:08.334906 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.334920 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.334953 (+ 33us) server_negotiation.cc:407] Connection header received
0807 05:00:08.335631 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.335649 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.335854 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.336123 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.336940 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.338144 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.339210 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.339778 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.339855 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.342690 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.342696 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.342710 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.342736 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.344417 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.344833 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.344837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.344839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.344913 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.345170 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.345172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.345174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.345453 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.345657 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.345838 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.345998 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":264,"spinlock_wait_cycles":2560,"thread_start_us":117,"threads_started":1}
I20260807 05:00:08.348579 4557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.253@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:08.355835 4561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.349168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58374 (local address 127.25.214.253:40677)
0807 05:00:08.349508 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.349513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.349524 (+ 11us) server_negotiation.cc:407] Connection header received
0807 05:00:08.349552 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.349553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.349586 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.349649 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.350023 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.350524 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.351216 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.351435 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.351519 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.353305 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.353308 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.353310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.353330 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.354393 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.354758 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.354761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.354763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.354827 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.355069 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.355073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.355075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.355237 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.355322 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.355547 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.355693 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":272}
I20260807 05:00:08.355835 4562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.349101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:58374)
0807 05:00:08.349219 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.349233 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.349315 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.349679 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.349681 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.349832 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.349922 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.349927 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.350622 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.350625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.351116 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.351123 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.351526 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.351530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.351623 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.352019 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.352029 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.353188 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.354489 (+ 1301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.354492 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.354494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.354675 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.354904 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.354906 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.354908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.354978 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.355325 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.355328 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.355408 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.355492 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.355640 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 05:00:08.359237 4557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Bootstrap starting.
I20260807 05:00:08.361691 4557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:08.362439 4557 log.cc:824] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:08.364552 4557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: No bootstrap required, opened a new log
I20260807 05:00:08.367563 4557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } }
I20260807 05:00:08.367805 4557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:08.367843 4557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170c6ff09b204c67af5ee2778565c3cf, State: Initialized, Role: FOLLOWER
I20260807 05:00:08.368315 4557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } }
I20260807 05:00:08.368768 4565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } } }
I20260807 05:00:08.368903 4565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:08.369609 4557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: configured and running, proceeding with master startup.
W20260807 05:00:08.374150 4582 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:00:08.374243 4582 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:00:08.376684 4441 master_runner.cc:428] Detected that this master 170c6ff09b204c67af5ee2778565c3cf is joining an existing cluster
I20260807 05:00:08.376760 4441 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.214.253:40677
I20260807 05:00:08.387243 4561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.379504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.25.214.253:40677)
0807 05:00:08.379602 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.379607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.379620 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:08.379655 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.379657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.379698 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.379773 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.380342 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.381105 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.382288 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.382613 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.382722 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.384102 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.384106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.384108 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.384128 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.385647 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.386072 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.386075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.386077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.386143 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.386348 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.386351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.386352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.386565 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.386628 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.386939 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.387072 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":38}
I20260807 05:00:08.387575 4595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.379120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:58384)
0807 05:00:08.379442 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.379458 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.379557 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.379803 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.379806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.380054 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.380220 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.380229 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.381241 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.381244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.382147 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.382159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.382743 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.382747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.382843 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.383403 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.383417 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.383962 (+ 545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.385750 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.385753 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.385756 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.385979 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.386218 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.386220 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.386222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.386281 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.386677 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.386680 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.386748 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.386869 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.387427 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":108,"threads_started":1}
I20260807 05:00:08.391644 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.380185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60382 (local address 127.25.214.254:38261)
0807 05:00:08.380311 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.380315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.383039 (+ 2724us) server_negotiation.cc:407] Connection header received
0807 05:00:08.383228 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.383232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.383288 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.383367 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.384027 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.384839 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.385978 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.386323 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.386406 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.388120 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.388124 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.388126 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.388155 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.389998 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.390516 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.390520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.390521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.390606 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.390858 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.390860 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.390861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.391045 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.391121 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.391413 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.391523 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 05:00:08.391721 4596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.380225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:60382)
0807 05:00:08.382959 (+ 2734us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.382973 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.383113 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.383507 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.383510 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.383755 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.383885 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.383894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.384988 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.384991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.385838 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.385849 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.386558 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.386561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.386654 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.387053 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.387065 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.387938 (+ 873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.390135 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.390138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.390141 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.390413 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.390690 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.390693 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.390695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.390781 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.391129 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.391132 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.391243 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.391350 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.391521 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2658,"thread_start_us":95,"threads_started":1}
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.254@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:08.405841 4561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.396552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58394 (local address 127.25.214.253:40677)
0807 05:00:08.396657 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.396661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.397008 (+ 347us) server_negotiation.cc:407] Connection header received
0807 05:00:08.397204 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.397206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.397252 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.397315 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.397979 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.398467 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.399319 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.399526 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.399612 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.402366 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.402371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.402373 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.402397 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.403873 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.404386 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.404390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.404391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.404463 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.404746 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.404749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.404751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.404969 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.405060 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.405559 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.405681 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 05:00:08.405895 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.396518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:58394)
0807 05:00:08.396892 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.396933 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.397066 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.397386 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.397393 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.397751 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.397865 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.397872 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.398571 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.398574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.399205 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.399214 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.399627 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.399631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.399746 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.400588 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.400604 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.402203 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.403985 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.403996 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.404003 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.404289 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.404545 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.404548 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.404551 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.404639 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.405092 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.405101 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.405278 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.405487 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.405710 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":109,"threads_started":1}
I20260807 05:00:08.407473 3690 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.214.253:40677: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf"
member_type: NON_VOTER
last_known_addr {
host: "127.25.214.253"
port: 40677
}
attrs {
promote: true
}
}
dest_uuid: "14c8825ad0e242998179be6717077459"
cas_config_opid_index: -1
I20260807 05:00:08.408417 3690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } }
I20260807 05:00:08.410640 4604 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 170c6ff09b204c67af5ee2778565c3cf (127.25.214.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } }
I20260807 05:00:08.411324 4521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:08.412523 4604 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.214.253:40677
I20260807 05:00:08.412760 4521 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Refusing update from remote peer 14c8825ad0e242998179be6717077459: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 05:00:08.412853 4604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } }
WARNING: no policy specified for oryx/127.25.214.252@KRBTEST.COM; defaulting to no policy
I20260807 05:00:08.412949 4604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:08.413373 4441 master.cc:537] Master@127.25.214.253:40677 shutting down...
I20260807 05:00:08.413652 4603 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.252@KRBTEST.COM" created.
W20260807 05:00:08.416626 3662 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 05:00:08.417447 3662 consensus_peers.cc:487] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 -> Peer 170c6ff09b204c67af5ee2778565c3cf (127.25.214.253:40677): Couldn't send request to peer 170c6ff09b204c67af5ee2778565c3cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 05:00:08.419433 4441 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:08.419703 4441 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:08.419807 4441 tablet_replica.cc:330] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: stopping tablet replica
I20260807 05:00:08.424561 4441 master.cc:552] Master@127.25.214.253:40677 shutdown complete.
I20260807 05:00:08.424605 4441 master_runner.cc:305] Clearing existing system tablet
I20260807 05:00:08.424834 4441 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.424888 4441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.425966 4441 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 05:00:08.426738 4616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.426957 4441 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.427078 4441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:08.427115 4441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
uuid: "170c6ff09b204c67af5ee2778565c3cf"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "40240e9eab5ac007a424b3941b8662ee"
server_key_iv: "1af553381bd14db18b755a91882d8df4"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.428930 4441 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:08.431736 4441 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 05:00:08.431813 4441 log.cc:1196] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 05:00:08.432024 4441 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Deleting consensus metadata
I20260807 05:00:08.432204 4441 master_runner.cc:315] Copying system tablet from 127.25.214.254:38261
I20260807 05:00:08.433404 4441 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: tablet copy: Beginning tablet copy session from remote peer at address 127.25.214.254:38261
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.252.keytab.
Entry for principal oryx/127.25.214.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.252.keytab.
I20260807 05:00:08.434679 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:39097
--webserver_interface=127.25.214.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.252.keytab
--principal=oryx/127.25.214.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:00:08.443073 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.434428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60390 (local address 127.25.214.254:38261)
0807 05:00:08.434554 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.434558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.436387 (+ 1829us) server_negotiation.cc:407] Connection header received
0807 05:00:08.436514 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.436518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.436577 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.436666 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.437145 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.437802 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.438612 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.438820 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.438909 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.439953 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.439957 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.439960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.439984 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.441451 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.441832 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.441835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.441837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.441973 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.442234 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.442237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.442239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.442423 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.442508 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.442808 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.442912 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:00:08.443084 4627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.434310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:60390)
0807 05:00:08.436276 (+ 1966us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.436292 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.436424 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.436689 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.436692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.436900 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.437026 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.437033 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.437923 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.437927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.438503 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.438512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.438925 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.438929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.439019 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.439495 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.439508 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.439813 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.441548 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.441551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.441553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.441745 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.442062 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.442065 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.442067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.442150 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.442560 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.442565 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.442651 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.442739 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.442890 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1886,"thread_start_us":81,"threads_started":1}
I20260807 05:00:08.443636 3724 tablet_copy_service.cc:140] P 14c8825ad0e242998179be6717077459: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 170c6ff09b204c67af5ee2778565c3cf ({username='oryx', principal='oryx/127.25.214.253@KRBTEST.COM'} at 127.0.0.1:60390)
I20260807 05:00:08.443813 3724 tablet_copy_service.cc:161] P 14c8825ad0e242998179be6717077459: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 170c6ff09b204c67af5ee2778565c3cf at {username='oryx', principal='oryx/127.25.214.253@KRBTEST.COM'} at 127.0.0.1:60390: session id = 170c6ff09b204c67af5ee2778565c3cf-00000000000000000000000000000000
I20260807 05:00:08.445590 3724 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 05:00:08.447227 4441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 05:00:08.449188 4441 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: tablet copy: Starting download of 0 data blocks...
I20260807 05:00:08.449396 4441 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: tablet copy: Starting download of 1 WAL segments...
I20260807 05:00:08.450969 4441 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 05:00:08.452461 3724 tablet_copy_service.cc:342] P 14c8825ad0e242998179be6717077459: Request end of tablet copy session 170c6ff09b204c67af5ee2778565c3cf-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.214.253@KRBTEST.COM'} at 127.0.0.1:60390
I20260807 05:00:08.452569 3724 tablet_copy_service.cc:433] P 14c8825ad0e242998179be6717077459: ending tablet copy session 170c6ff09b204c67af5ee2778565c3cf-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 170c6ff09b204c67af5ee2778565c3cf
I20260807 05:00:08.459656 4441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:08.461313 4633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.461447 4441 server_base.cc:1034] running on GCE node
W20260807 05:00:08.461568 4637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.461767 4634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.462021 4441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:08.462304 4441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:08.463433 4441 hybrid_clock.cc:648] HybridClock initialized: now 1786078808463421 us; error 29 us; skew 500 ppm
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:08.464861 4441 init.cc:377] Logged in from keytab as oryx/127.25.214.253@KRBTEST.COM (short username oryx)
I20260807 05:00:08.465272 4441 webserver.cc:460] Webserver started at http://127.25.214.253:36279/ using document root <none> and password file <none>
I20260807 05:00:08.465453 4441 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.465488 4441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.466571 4441 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:08.467433 4648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.467654 4441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:08.467730 4441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
uuid: "170c6ff09b204c67af5ee2778565c3cf"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "40240e9eab5ac007a424b3941b8662ee"
server_key_iv: "1af553381bd14db18b755a91882d8df4"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.467813 4441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.475951 4441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:08.478003 4441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:08.482663 4441 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.253:40677
I20260807 05:00:08.482682 4732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.253:40677 every 8 connection(s)
I20260807 05:00:08.483191 4441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
I20260807 05:00:08.484819 4733 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:00:08.485626 4733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Bootstrap starting.
I20260807 05:00:08.494460 4733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:00:08.494760 4733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: Bootstrap complete.
I20260807 05:00:08.495321 4733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } }
I20260807 05:00:08.495448 4733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 170c6ff09b204c67af5ee2778565c3cf, State: Initialized, Role: LEARNER
I20260807 05:00:08.495554 4733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } }
I20260807 05:00:08.495899 4738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } }
I20260807 05:00:08.496050 4733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:08.496155 4738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: LEARNER
I20260807 05:00:08.498744 4755 catalog_manager.cc:1259] Loaded cluster ID: 58ec4e9a9dd6469e87fe9651cbf2c408
I20260807 05:00:08.498852 4755 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: loading cluster ID for follower catalog manager: success
I20260807 05:00:08.500802 4755 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: acquiring CA information for follower catalog manager: success
I20260807 05:00:08.502080 4755 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 05:00:08.583103 4632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:08.583367 4632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:08.583412 4632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:08.587363 4632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:08.587419 4632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:08.587437 4632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:08.587455 4632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:08.587484 4632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:08.592803 4632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.252.keytab
--principal=oryx/127.25.214.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:39097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.214.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:08.593812 4632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:08.594852 4632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:08.603310 4764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.603348 4762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.603327 4761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.603482 4632 server_base.cc:1034] running on GCE node
I20260807 05:00:08.604125 4632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:08.605212 4632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:08.606369 4632 hybrid_clock.cc:648] HybridClock initialized: now 1786078808606352 us; error 30 us; skew 500 ppm
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:08.609027 4632 init.cc:377] Logged in from keytab as oryx/127.25.214.252@KRBTEST.COM (short username oryx)
I20260807 05:00:08.609867 4632 webserver.cc:460] Webserver started at http://127.25.214.252:37663/ using document root <none> and password file <none>
I20260807 05:00:08.610387 4632 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.610472 4632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.610697 4632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:08.612758 4632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/instance:
uuid: "adf174d1211841bc9c0d43f14be037b8"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "4e07d2a97f7bdc546927c85f7fd4b525"
server_key_iv: "93650aca86bf52fb93a4d7ccc842471a"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.613286 4632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal/instance:
uuid: "adf174d1211841bc9c0d43f14be037b8"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "4e07d2a97f7bdc546927c85f7fd4b525"
server_key_iv: "93650aca86bf52fb93a4d7ccc842471a"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.616808 4632 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 05:00:08.619019 4772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.620167 4632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 05:00:08.620276 4632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
uuid: "adf174d1211841bc9c0d43f14be037b8"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "4e07d2a97f7bdc546927c85f7fd4b525"
server_key_iv: "93650aca86bf52fb93a4d7ccc842471a"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.620362 4632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.654206 4632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:08.657073 4632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:08.657249 4632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:08.664155 4632 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.252:39097
I20260807 05:00:08.664413 4859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.252:39097 every 8 connection(s)
I20260807 05:00:08.665134 4632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
I20260807 05:00:08.668427 4860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:08.672736 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 4632
I20260807 05:00:08.672828 4860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.252@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.214.252@KRBTEST.COM
I20260807 05:00:08.686307 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.674912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60400 (local address 127.25.214.254:38261)
0807 05:00:08.675041 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.675046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.675328 (+ 282us) server_negotiation.cc:407] Connection header received
0807 05:00:08.675891 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.675894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.675944 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.676047 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.677130 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.677967 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.679310 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.679653 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.679758 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.682613 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.682617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.682619 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.682644 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.684117 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.684715 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.684718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.684721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.684811 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.685140 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.685143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.685144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.685369 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.685459 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.686010 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.686137 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:00:08.687077 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.674402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57388 (local address 127.25.214.252:39097)
0807 05:00:08.674831 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.674850 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.674889 (+ 39us) server_negotiation.cc:407] Connection header received
0807 05:00:08.675683 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.675702 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.675917 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.676114 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.677020 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.678237 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.679312 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.679858 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.679937 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.683029 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.683035 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.683045 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.683065 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.684672 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.685099 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.685105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.685107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.685184 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.685434 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.685437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.685439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.685771 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.685985 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.686133 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.686284 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"spinlock_wait_cycles":3456,"thread_start_us":121,"threads_started":1}
I20260807 05:00:08.687557 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.674736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:60400)
0807 05:00:08.675186 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.675234 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.675688 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.676151 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.676157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.676612 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.676975 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.676996 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.678085 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.678088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.679184 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.679195 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.679788 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.679791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.679923 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.680714 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.680734 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.682438 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.684235 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.684242 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.684252 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.684633 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.684909 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.684911 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.684912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.685050 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.685468 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.685474 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.685792 (+ 318us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.685963 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.687436 (+ 1473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":1177,"spinlock_wait_cycles":3968,"thread_start_us":167,"threads_started":1}
I20260807 05:00:08.688642 4860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:00:08.691907 3999 heartbeater.cc:503] Master 127.25.214.254:38261 was elected leader, sending a full tablet report...
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.252@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:08.696043 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.689114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:58408)
0807 05:00:08.689214 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.689225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.689282 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.689694 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.689696 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.689836 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.689923 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.689928 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.690803 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.690807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.691325 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.691333 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.691777 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.691780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.691866 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.692336 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.692350 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.693555 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.694908 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.694910 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.694911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.695098 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.695293 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.695295 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.695296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.695375 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.695689 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.695692 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.695767 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.695846 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.695939 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 05:00:08.696166 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.689243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58408 (local address 127.25.214.253:40677)
0807 05:00:08.689500 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.689503 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.689514 (+ 11us) server_negotiation.cc:407] Connection header received
0807 05:00:08.689549 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.689551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.689588 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.689665 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.690040 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.690707 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.691429 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.691665 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.691751 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.693679 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.693682 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.693684 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.693707 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.694816 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.695168 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.695170 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.695171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.695236 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.695433 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.695435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.695436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.695612 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.695683 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.695886 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.695980 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":87,"threads_started":1}
I20260807 05:00:08.696789 4860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.252@KRBTEST.COM for oryx/127.25.214.252@KRBTEST.COM
I20260807 05:00:08.703684 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.697205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.0.0.1:57392)
0807 05:00:08.697309 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.697322 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.697401 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.697587 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.697590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.697727 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.697785 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.697790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.698473 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.698476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.699011 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.699019 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.699425 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.699427 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.699489 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.699803 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.699812 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.700957 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.702441 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.702444 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.702446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.702619 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.702844 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.702847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.702849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.702928 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.703236 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.703239 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.703316 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.703397 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.703520 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":1}
I20260807 05:00:08.703694 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.697254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57392 (local address 127.25.214.252:39097)
0807 05:00:08.697341 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.697345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.697357 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:00:08.697472 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.697475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.697508 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.697566 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.697907 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.698373 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.699109 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.699335 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.699423 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.701071 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.701074 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.701076 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.701096 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.702332 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.702698 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.702701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.702703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.702768 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.703001 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.703004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.703006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.703153 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.703232 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.703451 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.703571 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":34}
I20260807 05:00:08.706977 4860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Bootstrap starting.
I20260807 05:00:08.709241 4860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:08.709919 4860 log.cc:824] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:08.711670 4860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: No bootstrap required, opened a new log
I20260807 05:00:08.714588 4860 raft_consensus.cc:348] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } }
I20260807 05:00:08.714789 4860 raft_consensus.cc:374] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:08.714823 4860 raft_consensus.cc:729] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf174d1211841bc9c0d43f14be037b8, State: Initialized, Role: FOLLOWER
I20260807 05:00:08.715204 4860 consensus_queue.cc:260] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } }
I20260807 05:00:08.715617 4877 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } } }
I20260807 05:00:08.715737 4877 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:08.716361 4860 sys_catalog.cc:564] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 05:00:08.720450 4897 catalog_manager.cc:1558] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:00:08.720525 4897 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:00:08.723768 4632 master_runner.cc:428] Detected that this master adf174d1211841bc9c0d43f14be037b8 is joining an existing cluster
I20260807 05:00:08.723827 4632 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.214.252:39097
I20260807 05:00:08.735410 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.727001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57408 (local address 127.25.214.252:39097)
0807 05:00:08.727093 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.727097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.727311 (+ 214us) server_negotiation.cc:407] Connection header received
0807 05:00:08.727465 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.727467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.727503 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.727547 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.728416 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.729190 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.730986 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.731255 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.731309 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.732517 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.732521 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.732523 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.732546 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.733918 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.734318 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.734321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.734323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.734395 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.734638 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.734641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.734643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.734806 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.734887 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.735131 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.735265 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":30}
I20260807 05:00:08.735424 4912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.726966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.0.0.1:57408)
0807 05:00:08.727233 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.727245 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.727374 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.727666 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.727668 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.728029 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.728275 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.728281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.730100 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.730102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.730875 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.730882 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.731430 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.731433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.731515 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.732002 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.732014 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.732394 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.734044 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.734047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.734049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.734232 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.734473 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.734476 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.734478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.734561 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.734888 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.734890 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.734974 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.735059 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.735212 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":63,"spinlock_wait_cycles":18176,"thread_start_us":85,"threads_started":1}
I20260807 05:00:08.740653 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 3798
I20260807 05:00:08.758287 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.726385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60404 (local address 127.25.214.254:38261)
0807 05:00:08.726518 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.726523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.727320 (+ 797us) server_negotiation.cc:407] Connection header received
0807 05:00:08.727507 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.727510 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.727561 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.727610 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.728412 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.729191 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.730263 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.730615 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.730690 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.753919 (+ 23229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.753924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.753927 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.753965 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.756148 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.756762 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.756766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.756768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.756877 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.757195 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.757198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.757200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.757450 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.757524 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.757953 (+ 429us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.758110 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 05:00:08.758287 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.726453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58420 (local address 127.25.214.253:40677)
0807 05:00:08.726771 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.726776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.727001 (+ 225us) server_negotiation.cc:407] Connection header received
0807 05:00:08.727205 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.727208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.727265 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.727319 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.728154 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.728981 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.730825 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.731523 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.731599 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.754508 (+ 22909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.754513 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.754516 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.754560 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.756255 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.756837 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.756841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.756843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.756933 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.757261 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.757264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.757266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.757525 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.757620 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.757965 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.758118 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226}
I20260807 05:00:08.758846 4915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.726601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:60404)
0807 05:00:08.727232 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.727245 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.727383 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.727740 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.727743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.728024 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.728271 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.728279 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.729324 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.729327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.730143 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.730151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.730857 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.730860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.730943 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.731478 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.731491 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.753656 (+ 22165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.756320 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.756323 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.756326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.756638 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.756995 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.756998 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.757000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.757092 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.757600 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.757603 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.757728 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.758474 (+ 746us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.758649 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":37,"spinlock_wait_cycles":9216,"thread_start_us":88,"threads_started":1}
I20260807 05:00:08.759316 4914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.726352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:58420)
0807 05:00:08.726910 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.726926 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.727085 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.727482 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.727485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.727828 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.727973 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.727981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.729156 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.729159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.730685 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.730697 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.731753 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.731756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.731845 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.753844 (+ 21999us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.753863 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.754300 (+ 437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.756398 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.756401 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.756403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.756721 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.757040 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.757043 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.757045 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.757140 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.757696 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.757698 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.757794 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.759014 (+ 1220us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.759154 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":128,"threads_started":1}
I20260807 05:00:08.761727 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:44367
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:38261
--webserver_port=37175
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078807, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.254@KRBTEST.COM for oryx/127.25.214.252@KRBTEST.COM
I20260807 05:00:08.771648 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.764101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57414 (local address 127.25.214.252:39097)
0807 05:00:08.764250 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.764254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.764266 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:00:08.764449 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.764452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.764508 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.764584 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.765003 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.765500 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.766585 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.766786 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.766869 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.768889 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.768893 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.768895 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.768917 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.770178 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.770565 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.770568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.770570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.770642 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.770886 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.770890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.770892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.771065 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.771149 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.771397 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.771496 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 05:00:08.771649 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.764015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.0.0.1:57414)
0807 05:00:08.764188 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.764205 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.764294 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.764620 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.764624 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.764802 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.764892 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.764898 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.765616 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.765620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.766481 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.766492 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.766892 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.766896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.766986 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.767401 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.767413 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.768767 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.770281 (+ 1514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.770284 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.770286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.770476 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.770725 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.770728 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.770730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.770807 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.771155 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.771158 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.771249 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.771333 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.771474 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 05:00:08.772841 3690 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.214.252:39097: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "adf174d1211841bc9c0d43f14be037b8"
member_type: NON_VOTER
last_known_addr {
host: "127.25.214.252"
port: 39097
}
attrs {
promote: true
}
}
dest_uuid: "14c8825ad0e242998179be6717077459"
cas_config_opid_index: 5
I20260807 05:00:08.773404 3690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } }
I20260807 05:00:08.774469 4603 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER adf174d1211841bc9c0d43f14be037b8 (127.25.214.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.776003 4603 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.214.252:39097
I20260807 05:00:08.776265 4603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.776362 4603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:08.777396 4821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:08.778836 4821 raft_consensus.cc:1261] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Refusing update from remote peer 14c8825ad0e242998179be6717077459: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 05:00:08.779446 4632 master.cc:537] Master@127.25.214.252:39097 shutting down...
I20260807 05:00:08.779805 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.774600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:58430)
0807 05:00:08.775147 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.775160 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.775233 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.775735 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.775739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.775758 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:08.775836 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.775843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.776988 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.776991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.778175 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.778186 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.779338 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.779342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.779427 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.779474 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.779606 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.779683 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484}
I20260807 05:00:08.780324 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.774834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58430 (local address 127.25.214.253:40677)
0807 05:00:08.775053 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.775058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.775305 (+ 247us) server_negotiation.cc:407] Connection header received
0807 05:00:08.775357 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.775360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.775420 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.775503 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:08.775970 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.776867 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.778318 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.778991 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.779114 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.779272 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.780050 (+ 778us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.780209 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260807 05:00:08.781028 4604 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:08.781401 4689 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 LEARNER]: Refusing update from remote peer 14c8825ad0e242998179be6717077459: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 05:00:08.781879 4604 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 05:00:08.787824 3664 consensus_peers.cc:487] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 -> Peer adf174d1211841bc9c0d43f14be037b8 (127.25.214.252:39097): Couldn't send request to peer adf174d1211841bc9c0d43f14be037b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 05:00:08.786700 4689 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER adf174d1211841bc9c0d43f14be037b8 (127.25.214.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.789902 4738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14c8825ad0e242998179be6717077459. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.789994 4738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: LEARNER
I20260807 05:00:08.790072 4738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: NON_VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: true } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.790113 4738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: LEARNER
I20260807 05:00:08.790313 4632 raft_consensus.cc:2229] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:08.790617 4632 raft_consensus.cc:2258] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:08.790742 4632 tablet_replica.cc:330] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: stopping tablet replica
I20260807 05:00:08.791167 4604 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: attempting to promote NON_VOTER 170c6ff09b204c67af5ee2778565c3cf to VOTER
I20260807 05:00:08.791656 4604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } }
I20260807 05:00:08.794014 4688 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 LEARNER]: Refusing update from remote peer 14c8825ad0e242998179be6717077459: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 05:00:08.794425 4603 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 05:00:08.796033 3664 consensus_peers.cc:487] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 -> Peer adf174d1211841bc9c0d43f14be037b8 (127.25.214.252:39097): Couldn't send request to peer adf174d1211841bc9c0d43f14be037b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 05:00:08.796237 4603 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 170c6ff09b204c67af5ee2778565c3cf (127.25.214.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.797475 4603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.797576 4603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:08.797703 4603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.797772 4603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:08.798307 4688 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 170c6ff09b204c67af5ee2778565c3cf (127.25.214.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.800323 4921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.800424 4921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:08.809893 4632 master.cc:552] Master@127.25.214.252:39097 shutdown complete.
I20260807 05:00:08.809947 4632 master_runner.cc:305] Clearing existing system tablet
I20260807 05:00:08.810171 4632 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.810223 4632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.811295 4632 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 05:00:08.812067 4926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.812310 4632 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.812435 4632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:08.812474 4632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
uuid: "adf174d1211841bc9c0d43f14be037b8"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "4e07d2a97f7bdc546927c85f7fd4b525"
server_key_iv: "93650aca86bf52fb93a4d7ccc842471a"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.814152 4632 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:08.816238 4632 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 05:00:08.816366 4632 log.cc:1196] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 05:00:08.816606 4632 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Deleting consensus metadata
I20260807 05:00:08.816766 4632 master_runner.cc:315] Copying system tablet from 127.25.214.254:38261
I20260807 05:00:08.817831 4632 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: tablet copy: Beginning tablet copy session from remote peer at address 127.25.214.254:38261
I20260807 05:00:08.825517 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.818470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60410 (local address 127.25.214.254:38261)
0807 05:00:08.818605 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.818609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.818834 (+ 225us) server_negotiation.cc:407] Connection header received
0807 05:00:08.818950 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.818953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.819003 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.819080 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.819546 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.820099 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.820916 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.821147 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.821235 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.822348 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:08.822352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:08.822354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:08.822382 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:08.823786 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.824266 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.824270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.824272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.824357 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:08.824646 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:08.824649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:08.824651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:08.824889 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:08.824981 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:08.825241 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 05:00:08.825350 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 05:00:08.825517 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.818372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:60410)
0807 05:00:08.818741 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.818753 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.818866 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.819109 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.819112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.819313 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.819433 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.819441 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.820193 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.820197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.820801 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.820810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.821254 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:08.821257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:08.821346 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:08.821866 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:08.821879 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:08.822207 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:08.823896 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.823899 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.823902 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.824175 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.824442 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:08.824445 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:08.824447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:08.824567 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:08.824982 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:08.824985 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:08.825085 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 05:00:08.825173 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 05:00:08.825336 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":100,"threads_started":1}
I20260807 05:00:08.826268 3724 tablet_copy_service.cc:140] P 14c8825ad0e242998179be6717077459: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer adf174d1211841bc9c0d43f14be037b8 ({username='oryx', principal='oryx/127.25.214.252@KRBTEST.COM'} at 127.0.0.1:60410)
I20260807 05:00:08.826367 3724 tablet_copy_service.cc:161] P 14c8825ad0e242998179be6717077459: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer adf174d1211841bc9c0d43f14be037b8 at {username='oryx', principal='oryx/127.25.214.252@KRBTEST.COM'} at 127.0.0.1:60410: session id = adf174d1211841bc9c0d43f14be037b8-00000000000000000000000000000000
I20260807 05:00:08.827404 3724 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 05:00:08.828681 4632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 05:00:08.830749 4632 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: tablet copy: Starting download of 0 data blocks...
I20260807 05:00:08.830950 4632 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: tablet copy: Starting download of 1 WAL segments...
I20260807 05:00:08.832335 4632 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 05:00:08.833911 3724 tablet_copy_service.cc:342] P 14c8825ad0e242998179be6717077459: Request end of tablet copy session adf174d1211841bc9c0d43f14be037b8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.214.252@KRBTEST.COM'} at 127.0.0.1:60410
I20260807 05:00:08.833992 3724 tablet_copy_service.cc:433] P 14c8825ad0e242998179be6717077459: ending tablet copy session adf174d1211841bc9c0d43f14be037b8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer adf174d1211841bc9c0d43f14be037b8
I20260807 05:00:08.841007 4632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:08.842550 4939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.842941 4940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.842986 4943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.843364 4632 server_base.cc:1034] running on GCE node
I20260807 05:00:08.843518 4632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:08.843791 4632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:08.844923 4632 hybrid_clock.cc:648] HybridClock initialized: now 1786078808844916 us; error 24 us; skew 500 ppm
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:08.846256 4632 init.cc:377] Logged in from keytab as oryx/127.25.214.252@KRBTEST.COM (short username oryx)
I20260807 05:00:08.846680 4632 webserver.cc:460] Webserver started at http://127.25.214.252:34033/ using document root <none> and password file <none>
I20260807 05:00:08.846868 4632 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.846904 4632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.847920 4632 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:08.848803 4953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.849020 4632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 05:00:08.849092 4632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
uuid: "adf174d1211841bc9c0d43f14be037b8"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "4e07d2a97f7bdc546927c85f7fd4b525"
server_key_iv: "93650aca86bf52fb93a4d7ccc842471a"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.849174 4632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.858424 4632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:08.860219 4632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:08.865415 4632 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.252:39097
I20260807 05:00:08.865429 5029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.252:39097 every 8 connection(s)
I20260807 05:00:08.866009 4632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
I20260807 05:00:08.867573 5030 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:00:08.868513 5030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Bootstrap starting.
I20260807 05:00:08.877657 5030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:00:08.877918 5030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Bootstrap complete.
I20260807 05:00:08.878396 5030 raft_consensus.cc:348] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } }
I20260807 05:00:08.878513 5030 raft_consensus.cc:729] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: adf174d1211841bc9c0d43f14be037b8, State: Initialized, Role: LEARNER
I20260807 05:00:08.878615 5030 consensus_queue.cc:260] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } }
I20260807 05:00:08.878923 5034 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:08.879050 5030 sys_catalog.cc:564] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:08.879105 5034 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: This master's current role is: LEARNER
I20260807 05:00:08.882367 5058 catalog_manager.cc:1259] Loaded cluster ID: 58ec4e9a9dd6469e87fe9651cbf2c408
I20260807 05:00:08.882413 5058 catalog_manager.cc:1552] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: loading cluster ID for follower catalog manager: success
I20260807 05:00:08.884020 5058 catalog_manager.cc:1574] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: acquiring CA information for follower catalog manager: success
I20260807 05:00:08.885142 5058 catalog_manager.cc:1602] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:00:08.910823 4210 heartbeater.cc:503] Master 127.25.214.254:38261 was elected leader, sending a full tablet report...
W20260807 05:00:08.923170 4916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:08.923432 4916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:08.923475 4916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:08.927403 4916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:08.927461 4916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:08.927520 4916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:08.932668 4916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:44367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=37175
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:08.933645 4916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:08.934643 4916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:08.944375 5065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.944401 5068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:08.944406 5066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:08.944720 4916 server_base.cc:1034] running on GCE node
I20260807 05:00:08.945101 4916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:08.945688 4916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:08.946851 4916 hybrid_clock.cc:648] HybridClock initialized: now 1786078808946835 us; error 25 us; skew 500 ppm
Aug 07 05:00:08 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:08.949605 4916 init.cc:377] Logged in from keytab as oryx/127.25.214.193@KRBTEST.COM (short username oryx)
I20260807 05:00:08.950449 4916 webserver.cc:460] Webserver started at http://127.25.214.193:37175/ using document root <none> and password file <none>
I20260807 05:00:08.951018 4916 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:08.951100 4916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:08.954892 4916 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:08.956902 5083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.958068 4916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:08.958179 4916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "cf646928cfe64bb18210d3a1d9221af6"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "532925bd137d95f57dadbccdeee7476f"
server_key_iv: "a856bb1e0ce4e554c14e9fc41fcf41b5"
server_key_version: "encryptionkey@0"
I20260807 05:00:08.958734 4916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:08.978328 4916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:08.981515 4916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:08.981707 4916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:08.982326 4916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:08.983258 4916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:08.983306 4916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.983362 4916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:08.983390 4916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:08.992640 4916 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:44367
I20260807 05:00:08.992663 5266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:44367 every 8 connection(s)
I20260807 05:00:08.993650 4916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:09.002489 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 4916
I20260807 05:00:09.002683 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 4005
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:09.013682 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.995427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46495 (local address 127.25.214.253:40677)
0807 05:00:08.995563 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.995568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.996610 (+ 1042us) server_negotiation.cc:407] Connection header received
0807 05:00:08.997854 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.997857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.997917 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.997982 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.999352 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:08.999921 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.001602 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.001910 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.002014 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.009172 (+ 7158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.009177 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.009180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.009210 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.010875 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.011673 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.011678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.011680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.011779 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.012284 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.012288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.012290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.012542 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.012624 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.013362 (+ 738us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.013501 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 05:00:09.013682 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.997069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:38207 (local address 127.25.214.254:38261)
0807 05:00:08.997183 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.997187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.997231 (+ 44us) server_negotiation.cc:407] Connection header received
0807 05:00:08.997875 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.997878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.997935 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.997987 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.999374 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.000199 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.001640 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.001905 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.002029 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.009806 (+ 7777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.009809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.009812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.009846 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.011764 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.012315 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.012319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.012320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.012420 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.012730 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.012733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.012735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.012940 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.013012 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.013362 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.013501 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:00:09.015424 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.995861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.25.214.193:46495)
0807 05:00:08.996459 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.996512 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.997636 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.998254 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.998261 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.998680 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.999214 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.999227 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.000116 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.000120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.001489 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.001501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.002084 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.002088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.002197 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.007450 (+ 5253us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.007465 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.008965 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.011038 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.011045 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.011066 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.011530 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.011895 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.011898 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.011900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.012160 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.012691 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.012699 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.013072 (+ 373us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.014271 (+ 1199us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.014390 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":51,"spinlock_wait_cycles":1792,"thread_start_us":150,"threads_started":1}
I20260807 05:00:09.015424 5275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.996894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:38207)
0807 05:00:08.997153 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.997166 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.997656 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.998255 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.998263 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.998681 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.999217 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.999231 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.000317 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.000320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.001489 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.001501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.002413 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.002417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.002501 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.006753 (+ 4252us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.006773 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.009353 (+ 2580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.011895 (+ 2542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.011898 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.011900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.012203 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.012541 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.012543 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.012545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.012628 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.013084 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.013087 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.013159 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.013862 (+ 703us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.014257 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":90,"spinlock_wait_cycles":13952,"thread_start_us":89,"threads_started":1}
I20260807 05:00:09.017117 5269 heartbeater.cc:347] Connected to a master server at 127.25.214.253:40677
I20260807 05:00:09.017367 5269 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.017894 5269 heartbeater.cc:511] Master 127.25.214.253:40677 requested a full tablet report, sending...
I20260807 05:00:09.019327 4675 ts_manager.cc:194] Registered new tserver with Master: cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367)
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078808, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.252@KRBTEST.COM
I20260807 05:00:09.033800 5267 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38261
I20260807 05:00:09.033937 5267 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.034170 5267 heartbeater.cc:511] Master 127.25.214.254:38261 requested a full tablet report, sending...
I20260807 05:00:09.035207 3690 ts_manager.cc:194] Re-registered known tserver with Master: cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367)
I20260807 05:00:09.035915 3690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:38207
I20260807 05:00:09.038022 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.995415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:37515 (local address 127.25.214.252:39097)
0807 05:00:08.995682 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:08.995687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:08.996803 (+ 1116us) server_negotiation.cc:407] Connection header received
0807 05:00:08.997944 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:08.997947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:08.998000 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:08.998073 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:08.999372 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.000445 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.001393 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.001727 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.001819 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.034413 (+ 32594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.034418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.034421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.034456 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.036297 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.036780 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.036784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.036786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.036886 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.037161 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.037164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.037166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.037360 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.037449 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.037702 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.037838 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":78,"threads_started":1}
I20260807 05:00:09.038026 5273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:08.995861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.25.214.193:37515)
0807 05:00:08.996696 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:08.996710 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:08.997652 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:08.998255 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:08.998263 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:08.998684 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:08.999217 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:08.999231 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.000545 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.000549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.001284 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.001293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.001868 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.001872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.002078 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.032608 (+ 30530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.032627 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.034172 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.036420 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.036423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.036425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.036669 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.036976 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.036980 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.036982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.037068 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.037452 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.037455 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.037545 (+ 90us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.037635 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.037821 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"mutex_wait_us":104,"spinlock_wait_cycles":100352,"thread_start_us":176,"threads_started":1}
I20260807 05:00:09.039269 5268 heartbeater.cc:347] Connected to a master server at 127.25.214.252:39097
I20260807 05:00:09.039398 5268 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.039605 5268 heartbeater.cc:511] Master 127.25.214.252:39097 requested a full tablet report, sending...
I20260807 05:00:09.040599 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:40341
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:38261
--webserver_port=36673
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:00:09.040870 4967 ts_manager.cc:194] Registered new tserver with Master: cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367)
I20260807 05:00:09.131855 4435 heartbeater.cc:503] Master 127.25.214.254:38261 was elected leader, sending a full tablet report...
W20260807 05:00:09.156203 5277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:09.156473 5277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:09.156536 5277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:09.160468 5277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:09.160540 5277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:09.160619 5277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:09.166199 5277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:40341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=36673
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:09.167383 5277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:09.168550 5277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:09.178373 5293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:09.178391 5294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:09.178443 5297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:09.178567 5277 server_base.cc:1034] running on GCE node
I20260807 05:00:09.179050 5277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:09.179695 5277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:09.180853 5277 hybrid_clock.cc:648] HybridClock initialized: now 1786078809180832 us; error 32 us; skew 500 ppm
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:09.183543 5277 init.cc:377] Logged in from keytab as oryx/127.25.214.194@KRBTEST.COM (short username oryx)
I20260807 05:00:09.184451 5277 webserver.cc:460] Webserver started at http://127.25.214.194:36673/ using document root <none> and password file <none>
I20260807 05:00:09.184983 5277 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:09.185067 5277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:09.188859 5277 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:09.190918 5311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:09.192222 5277 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:09.192332 5277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "8f5de97a55004698805a2274c682e9bb"
format_stamp: "Formatted at 2026-08-07 05:00:07 on dist-test-slave-lgr5"
server_key: "27487657bb887bb5d3ee2bbc34a2a2a9"
server_key_iv: "a1078409a2c6decdd60bbb8f30a96591"
server_key_version: "encryptionkey@0"
I20260807 05:00:09.192878 5277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:09.216269 5277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:09.219534 5277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:09.219725 5277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:09.220393 5277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:09.221292 5277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:09.221342 5277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:09.221397 5277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:09.221426 5277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:09.229874 5277 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:40341
I20260807 05:00:09.229893 5498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:40341 every 8 connection(s)
I20260807 05:00:09.230967 5277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:09.237991 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 5277
I20260807 05:00:09.238176 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 4222
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.252@KRBTEST.COM
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:09.248731 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.234585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:52217 (local address 127.25.214.254:38261)
0807 05:00:09.234722 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.234727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.234747 (+ 20us) server_negotiation.cc:407] Connection header received
0807 05:00:09.235324 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.235328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.235397 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.235471 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.236890 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.237724 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.240976 (+ 3252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.241303 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.241406 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.244262 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.244266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.244269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.244301 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.246074 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.246812 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.246816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.246818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.246909 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.247348 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.247352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.247354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.247572 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.247650 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.248433 (+ 783us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.248558 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 05:00:09.248731 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.232903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:35287 (local address 127.25.214.252:39097)
0807 05:00:09.233064 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.233069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.234232 (+ 1163us) server_negotiation.cc:407] Connection header received
0807 05:00:09.235369 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.235373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.235431 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.235489 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.236932 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.237705 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.239761 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.240040 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.240122 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.243901 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.243906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.243909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.243937 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.245519 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.246812 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.246816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.246818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.246908 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.247349 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.247352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.247354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.247572 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.247644 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.248433 (+ 789us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.248558 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 05:00:09.249553 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.232959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:59261 (local address 127.25.214.253:40677)
0807 05:00:09.233090 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.233094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.234166 (+ 1072us) server_negotiation.cc:407] Connection header received
0807 05:00:09.235375 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.235379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.235431 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.235489 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.236924 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.237485 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.241728 (+ 4243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.242145 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.242259 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.244994 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.245000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.245003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.245036 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.247178 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.247767 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.247771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.247774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.247884 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.248342 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.248346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.248349 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.248646 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.248747 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.249225 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.249370 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:00:09.250345 5505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.233366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.25.214.194:35287)
0807 05:00:09.234141 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.234155 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.235132 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.235659 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.235668 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.236190 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:09.236760 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.236768 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.237842 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.237846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.239653 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.239660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.240309 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.240312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.240496 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.241199 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.241220 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.243720 (+ 2500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.246199 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.246205 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.246222 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.246693 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.247017 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.247020 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.247022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.247236 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.247718 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.247725 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.248136 (+ 411us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.248891 (+ 755us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.249250 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"mutex_wait_us":1199,"spinlock_wait_cycles":42752,"thread_start_us":151,"threads_started":1}
I20260807 05:00:09.250662 5508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.234443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:52217)
0807 05:00:09.234687 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.234698 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.235126 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.235659 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.235666 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.236175 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:09.236747 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.236761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.237842 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.237846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.238969 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.238980 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.241532 (+ 2552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.241536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.241630 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.242078 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.242093 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.244072 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.246199 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.246205 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.246222 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.246693 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.247017 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.247020 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.247022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.247236 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.247718 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.247725 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.248136 (+ 411us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.249327 (+ 1191us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.249450 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":102,"spinlock_wait_cycles":85760,"thread_start_us":87,"threads_started":1}
I20260807 05:00:09.250352 5506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.233359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.25.214.194:59261)
0807 05:00:09.233986 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.234048 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.235124 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.235659 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.235668 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.236178 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:09.236758 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.236768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.237651 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.237653 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.241554 (+ 3901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.241568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.242492 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.242496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.242606 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.243104 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.243119 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.244800 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.247329 (+ 2529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.247333 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.247335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.247626 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.248017 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.248020 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.248023 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.248204 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.248819 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.248822 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.248929 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.249799 (+ 870us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.249966 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":2646,"spinlock_wait_cycles":95232,"thread_start_us":140,"threads_started":1}
I20260807 05:00:09.251678 5499 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38261
I20260807 05:00:09.252012 5499 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.252821 5499 heartbeater.cc:511] Master 127.25.214.254:38261 requested a full tablet report, sending...
I20260807 05:00:09.253542 5501 heartbeater.cc:347] Connected to a master server at 127.25.214.253:40677
I20260807 05:00:09.253643 5501 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.253849 5501 heartbeater.cc:511] Master 127.25.214.253:40677 requested a full tablet report, sending...
I20260807 05:00:09.254114 3690 ts_manager.cc:194] Re-registered known tserver with Master: 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:09.254698 4675 ts_manager.cc:194] Registered new tserver with Master: 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:09.254707 3690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:52217
I20260807 05:00:09.261183 5500 heartbeater.cc:347] Connected to a master server at 127.25.214.252:39097
I20260807 05:00:09.261271 5500 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.261459 5500 heartbeater.cc:511] Master 127.25.214.252:39097 requested a full tablet report, sending...
I20260807 05:00:09.262204 4967 ts_manager.cc:194] Registered new tserver with Master: 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:09.266705 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:42217
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:38261
--webserver_port=34837
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:00:09.379942 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.374903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57430 (local address 127.25.214.252:39097)
0807 05:00:09.375105 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.375111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.375244 (+ 133us) server_negotiation.cc:407] Connection header received
0807 05:00:09.375490 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.375494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.375565 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.375637 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:09.376106 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.376895 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.378474 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.379103 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.379201 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.379349 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.379718 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.379805 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 05:00:09.380420 5519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.374527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.0.0.1:57430)
0807 05:00:09.375146 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.375163 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.375344 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.375801 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.375805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.375826 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:09.375931 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.375936 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.377144 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.377147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.378309 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.378321 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.379469 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.379474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.379570 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.379596 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.380189 (+ 593us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.380283 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":62,"threads_started":1}
I20260807 05:00:09.381100 4986 raft_consensus.cc:1203] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 05:00:09.382165 5520 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14c8825ad0e242998179be6717077459. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:09.382313 5520 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: This master's current role is: LEARNER
W20260807 05:00:09.401957 5511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:09.402266 5511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:09.402315 5511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:09.406342 5511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:09.406407 5511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:09.406486 5511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:09.411876 5511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:42217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=34837
--tserver_master_addrs=127.25.214.254:38261,127.25.214.253:40677,127.25.214.252:39097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:09.413089 5511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:09.414108 5511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:09.423581 5537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:09.423693 5540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:09.423585 5532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:09.423902 5511 server_base.cc:1034] running on GCE node
I20260807 05:00:09.424489 5511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:09.425099 5511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:09.426301 5511 hybrid_clock.cc:648] HybridClock initialized: now 1786078809426278 us; error 34 us; skew 500 ppm
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:09.428988 5511 init.cc:377] Logged in from keytab as oryx/127.25.214.195@KRBTEST.COM (short username oryx)
I20260807 05:00:09.429903 5511 webserver.cc:460] Webserver started at http://127.25.214.195:34837/ using document root <none> and password file <none>
I20260807 05:00:09.430436 5511 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:09.430514 5511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:09.434520 5511 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 05:00:09.436595 5547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:09.437767 5511 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:09.437879 5511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "5585fc20ee6d46988a9665b0327a34d7"
format_stamp: "Formatted at 2026-08-07 05:00:08 on dist-test-slave-lgr5"
server_key: "51a26791cbb18ca54871363f8f98cfa2"
server_key_iv: "d4fb8062b4190fe802a6f1fe0585efb0"
server_key_version: "encryptionkey@0"
I20260807 05:00:09.438406 5511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:09.457391 5511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:09.460479 5511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:09.460655 5511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:09.461264 5511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:09.462162 5511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:09.462212 5511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:09.462258 5511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:09.462286 5511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:09.471026 5511 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:42217
I20260807 05:00:09.471055 5730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:42217 every 8 connection(s)
I20260807 05:00:09.472026 5511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:09.473676 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 5511
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.252@KRBTEST.COM
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
Aug 07 05:00:09 dist-test-slave-lgr5 krb5kdc[3613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078809, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.253@KRBTEST.COM
I20260807 05:00:09.489244 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.473778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:59961 (local address 127.25.214.252:39097)
0807 05:00:09.473910 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.473915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.475655 (+ 1740us) server_negotiation.cc:407] Connection header received
0807 05:00:09.476519 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.476522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.476583 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.476642 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.478567 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.479351 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481153 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.481434 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481505 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.485013 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.485018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.485021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.485051 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.486634 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.487381 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.487385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.487387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.487479 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.487910 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.487914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.487916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.488172 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.488255 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.488950 (+ 695us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.489076 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 05:00:09.490859 5752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.474255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.25.214.195:59961)
0807 05:00:09.475557 (+ 1302us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.475569 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.476259 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.477065 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.477075 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.477632 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:09.478405 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.478428 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.479540 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.479543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.481026 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.481036 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.481706 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.481972 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.482841 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.482876 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.484796 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.486762 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.486769 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.486786 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.487259 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.487597 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.487599 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.487601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.487776 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.488326 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.488332 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.488654 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.489400 (+ 746us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.489776 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1219,"mutex_wait_us":67,"spinlock_wait_cycles":63104,"thread_start_us":136,"threads_started":1}
I20260807 05:00:09.492416 5735 heartbeater.cc:347] Connected to a master server at 127.25.214.252:39097
I20260807 05:00:09.492662 5735 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.493199 5735 heartbeater.cc:511] Master 127.25.214.252:39097 requested a full tablet report, sending...
I20260807 05:00:09.494076 5754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.476182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.25.214.253:40677)
0807 05:00:09.476503 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.476507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.477103 (+ 596us) server_negotiation.cc:407] Connection header received
0807 05:00:09.477293 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.477296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.477382 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.477451 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.478499 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.479352 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.480574 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.480955 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481031 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.486258 (+ 5227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.486262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.486265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.486291 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.487973 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.490515 (+ 2542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.490519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.490521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.490616 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.490926 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.490930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.490931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.491146 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.491267 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.493776 (+ 2509us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.493916 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"spinlock_wait_cycles":12032,"thread_start_us":95,"threads_started":1}
I20260807 05:00:09.494403 4967 ts_manager.cc:194] Registered new tserver with Master: 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217)
I20260807 05:00:09.495823 5757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.477177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57446 (local address 127.25.214.252:39097)
0807 05:00:09.478060 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.478064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.478375 (+ 311us) server_negotiation.cc:407] Connection header received
0807 05:00:09.478420 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.478423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.478471 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.478548 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.479486 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.480337 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481433 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.481732 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481819 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.490148 (+ 8329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.490152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.490155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.490181 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.493630 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.494067 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.494070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.494072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.494356 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.494695 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.494698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.494700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.494908 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.495022 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.495533 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.495656 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":95,"threads_started":1}
I20260807 05:00:09.497306 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.474089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:43235 (local address 127.25.214.253:40677)
0807 05:00:09.474204 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.474209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.475277 (+ 1068us) server_negotiation.cc:407] Connection header received
0807 05:00:09.477295 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.477299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.477364 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.477436 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.482004 (+ 4568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.482688 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.483678 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.483964 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.484037 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.490026 (+ 5989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.490029 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.490032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.490056 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.492178 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.495420 (+ 3242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.495423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.495425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.495527 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.496354 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.496357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.496359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.496562 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.496637 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.497003 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.497142 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48,"spinlock_wait_cycles":4864}
I20260807 05:00:09.497401 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.475325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:48051)
0807 05:00:09.475717 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.475730 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.476516 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.477065 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.477075 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.478230 (+ 1155us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:09.478411 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.478428 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.479543 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.479547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.481061 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.481072 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.481727 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.482917 (+ 1186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.483353 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.483367 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.487491 (+ 4124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.489656 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.489659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.489661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.489900 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.495418 (+ 5518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.495421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.495422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.495668 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.496716 (+ 1048us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.496719 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.496801 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.496921 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.497165 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":1210,"spinlock_wait_cycles":3456,"thread_start_us":83,"threads_started":1}
I20260807 05:00:09.497423 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.475714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:48051 (local address 127.25.214.254:38261)
0807 05:00:09.475829 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.475833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.475846 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:09.476631 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.476634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.476681 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.476744 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.478579 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.479366 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481187 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.481506 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.481574 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.487613 (+ 6039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.487617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.487619 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.487645 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.489215 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.492779 (+ 3564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.492783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.492785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.492871 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.496256 (+ 3385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.496260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.496262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.496483 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.496573 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.497109 (+ 536us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.497247 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 05:00:09.498323 5732 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38261
I20260807 05:00:09.498430 5732 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.498497 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.474255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.25.214.195:43235)
0807 05:00:09.475122 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.475174 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.476246 (+ 1072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.477661 (+ 1415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.477664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.477852 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:09.479887 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.479895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.482816 (+ 2921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.482819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.483528 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.483540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.484251 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.484255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.484455 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.485765 (+ 1310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:09.485778 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:09.487311 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:09.495056 (+ 7745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.495059 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.495079 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.495312 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.495823 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:09.495826 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:09.495828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:09.496243 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:09.496698 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:09.496700 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:09.496797 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.496909 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.498292 (+ 1383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":2828,"thread_start_us":148,"threads_started":1}
I20260807 05:00:09.498618 5732 heartbeater.cc:511] Master 127.25.214.254:38261 requested a full tablet report, sending...
I20260807 05:00:09.499011 5736 heartbeater.cc:347] Connected to a master server at 127.25.214.253:40677
I20260807 05:00:09.499099 5736 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:09.499225 5736 heartbeater.cc:511] Master 127.25.214.253:40677 requested a full tablet report, sending...
I20260807 05:00:09.499274 3690 ts_manager.cc:194] Re-registered known tserver with Master: 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217)
I20260807 05:00:09.499853 4675 ts_manager.cc:194] Registered new tserver with Master: 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217)
I20260807 05:00:09.499907 3690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:48051
I20260807 05:00:09.500967 5755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.476690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60414 (local address 127.25.214.254:38261)
0807 05:00:09.482464 (+ 5774us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.482469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.482482 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:09.482516 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.482519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.482562 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.482798 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.483639 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.485851 (+ 2212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.489679 (+ 3828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.489996 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.491924 (+ 1928us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.495513 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.495517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.495519 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.495542 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.498126 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.498754 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.498757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.498759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.498847 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.500125 (+ 1278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.500128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.500130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.500333 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.500496 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.500691 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.500809 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5700,"thread_start_us":78,"threads_started":1}
I20260807 05:00:09.503569 3690 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:09.506650 3690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:09.509564 5521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: NON_VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: true } } }
I20260807 05:00:09.509719 5521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:09.513012 5764 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: attempting to promote NON_VOTER adf174d1211841bc9c0d43f14be037b8 to VOTER
I20260807 05:00:09.513362 5764 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } }
I20260807 05:00:09.514569 4986 raft_consensus.cc:1261] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 LEARNER]: Refusing update from remote peer 14c8825ad0e242998179be6717077459: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 05:00:09.515055 5764 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 05:00:09.515141 4688 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Refusing update from remote peer 14c8825ad0e242998179be6717077459: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 05:00:09.515784 5764 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 05:00:09.517911 5516 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, adf174d1211841bc9c0d43f14be037b8 (127.25.214.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.517939 4688 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, adf174d1211841bc9c0d43f14be037b8 (127.25.214.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.518527 4986 raft_consensus.cc:2932] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, adf174d1211841bc9c0d43f14be037b8 (127.25.214.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.519316 5516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.519419 5516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:09.519580 5763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.519695 5763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:09.519584 5516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.519790 5516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:09.520566 5520 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.520687 5520 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:09.521190 5778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "14c8825ad0e242998179be6717077459" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:09.521312 5778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:09.528156 5519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.523202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:44367 (local address 127.0.0.1:51750)
0807 05:00:09.523296 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.523311 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.523396 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.524942 (+ 1546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.524945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.524964 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:09.525063 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.525070 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.525994 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.525997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.526949 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.526960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.527744 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.527747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.527830 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.527852 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.527910 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.527984 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 05:00:09.528182 5785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.524237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51750 (local address 127.25.214.193:44367)
0807 05:00:09.524531 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.524538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.524564 (+ 26us) server_negotiation.cc:407] Connection header received
0807 05:00:09.524641 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.524645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.524814 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.524953 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:09.525152 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.525883 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.527076 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.527632 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.527745 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.527894 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.527946 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.528033 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":73,"threads_started":1}
I20260807 05:00:09.529361 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.523810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40341 (local address 127.0.0.1:35214)
0807 05:00:09.524038 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.524052 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.524162 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.525083 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.525086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.525119 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:09.525405 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.525410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.526747 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.526751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.527957 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.527967 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.529062 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.529066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.529131 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.529152 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.529200 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.529252 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":191,"spinlock_wait_cycles":9856,"thread_start_us":104,"threads_started":1}
I20260807 05:00:09.529469 5782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.523972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35214 (local address 127.25.214.194:40341)
0807 05:00:09.524604 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.524616 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.524639 (+ 23us) server_negotiation.cc:407] Connection header received
0807 05:00:09.524717 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.524722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.524925 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.525182 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:09.525505 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.526622 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.528192 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.528934 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.529064 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.529185 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.529234 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.529317 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":122,"threads_started":1}
I20260807 05:00:09.531529 5779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.523482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:42217 (local address 127.0.0.1:37238)
0807 05:00:09.523703 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.523716 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.523797 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.525083 (+ 1286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.525086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.525113 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:09.525239 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.525247 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.527032 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.527035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.528327 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.528337 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.531149 (+ 2812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.531152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.531252 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.531275 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.531323 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.531403 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":184,"spinlock_wait_cycles":384,"thread_start_us":101,"threads_started":1}
I20260807 05:00:09.531342 5162 tablet_service.cc:1467] Processing CreateTablet for tablet 4912160830d649c6a1754bed220af0eb (DEFAULT_TABLE table=test-table [id=108b838f14f2403cbd4bf61e3b7bad98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:09.532236 5786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.524300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.25.214.195:42217)
0807 05:00:09.524604 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.524616 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.524639 (+ 23us) server_negotiation.cc:407] Connection header received
0807 05:00:09.524717 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.524722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.524921 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.525559 (+ 638us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:09.525697 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.526914 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.530213 (+ 3299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.531007 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.531802 (+ 795us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.531935 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.531987 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.532096 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":104,"threads_started":1}
I20260807 05:00:09.531920 5388 tablet_service.cc:1467] Processing CreateTablet for tablet 4912160830d649c6a1754bed220af0eb (DEFAULT_TABLE table=test-table [id=108b838f14f2403cbd4bf61e3b7bad98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:09.532605 5162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4912160830d649c6a1754bed220af0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:09.532895 5388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4912160830d649c6a1754bed220af0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:09.534704 5625 tablet_service.cc:1467] Processing CreateTablet for tablet 4912160830d649c6a1754bed220af0eb (DEFAULT_TABLE table=test-table [id=108b838f14f2403cbd4bf61e3b7bad98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:09.535688 5625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4912160830d649c6a1754bed220af0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:09.539667 5787 tablet_bootstrap.cc:492] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Bootstrap starting.
I20260807 05:00:09.540879 5788 tablet_bootstrap.cc:492] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Bootstrap starting.
I20260807 05:00:09.543159 5788 tablet_bootstrap.cc:654] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:09.543159 5787 tablet_bootstrap.cc:654] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:09.543332 5789 tablet_bootstrap.cc:492] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Bootstrap starting.
I20260807 05:00:09.544106 5788 log.cc:824] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:09.544106 5787 log.cc:824] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:09.545259 5789 tablet_bootstrap.cc:654] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:09.545889 5789 log.cc:824] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:09.546054 5787 tablet_bootstrap.cc:492] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: No bootstrap required, opened a new log
I20260807 05:00:09.546253 5787 ts_tablet_manager.cc:1397] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 05:00:09.546635 5788 tablet_bootstrap.cc:492] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: No bootstrap required, opened a new log
I20260807 05:00:09.546813 5788 ts_tablet_manager.cc:1397] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:00:09.547499 5789 tablet_bootstrap.cc:492] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: No bootstrap required, opened a new log
I20260807 05:00:09.547665 5789 ts_tablet_manager.cc:1397] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 05:00:09.550693 5788 raft_consensus.cc:348] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.550767 5787 raft_consensus.cc:348] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.550976 5788 raft_consensus.cc:374] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:09.550974 5787 raft_consensus.cc:374] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:09.551034 5787 raft_consensus.cc:729] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f5de97a55004698805a2274c682e9bb, State: Initialized, Role: FOLLOWER
I20260807 05:00:09.551034 5788 raft_consensus.cc:729] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf646928cfe64bb18210d3a1d9221af6, State: Initialized, Role: FOLLOWER
I20260807 05:00:09.551167 5789 raft_consensus.cc:348] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.551397 5789 raft_consensus.cc:374] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:09.551457 5789 raft_consensus.cc:729] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5585fc20ee6d46988a9665b0327a34d7, State: Initialized, Role: FOLLOWER
I20260807 05:00:09.551486 5788 consensus_queue.cc:260] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.551486 5787 consensus_queue.cc:260] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.551883 5789 consensus_queue.cc:260] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.552181 5267 heartbeater.cc:503] Master 127.25.214.254:38261 was elected leader, sending a full tablet report...
I20260807 05:00:09.552497 5787 ts_tablet_manager.cc:1428] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:00:09.552508 5788 ts_tablet_manager.cc:1428] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:00:09.552752 5499 heartbeater.cc:503] Master 127.25.214.254:38261 was elected leader, sending a full tablet report...
I20260807 05:00:09.552809 5789 ts_tablet_manager.cc:1428] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260807 05:00:09.553122 5732 heartbeater.cc:503] Master 127.25.214.254:38261 was elected leader, sending a full tablet report...
I20260807 05:00:09.573304 5801 raft_consensus.cc:482] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:09.573478 5801 raft_consensus.cc:504] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.574573 5801 leader_election.cc:288] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367), 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:09.578222 5785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.574939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:54461 (local address 127.25.214.193:44367)
0807 05:00:09.575078 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.575082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.575209 (+ 127us) server_negotiation.cc:407] Connection header received
0807 05:00:09.575325 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.575328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.575376 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.575441 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:09.575717 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.576263 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.577276 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.577660 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.577749 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.577798 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.578020 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.578089 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 05:00:09.578238 5782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.574948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:33267 (local address 127.25.214.194:40341)
0807 05:00:09.575091 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.575096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.575115 (+ 19us) server_negotiation.cc:407] Connection header received
0807 05:00:09.575220 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.575223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.575272 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.575342 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:09.575641 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.576228 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.577288 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.577714 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.577848 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.577906 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.578038 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.578109 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 05:00:09.578249 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.574838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:44367 (local address 127.25.214.195:54461)
0807 05:00:09.575126 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.575141 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.575233 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.575467 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.575469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.575485 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:09.575591 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.575598 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.576375 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.576378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.577147 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.577157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.577773 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.577778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.577887 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.577917 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.577994 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.578079 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":132}
I20260807 05:00:09.578258 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.574825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40341 (local address 127.25.214.195:33267)
0807 05:00:09.574977 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:09.574992 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:09.575106 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:09.575368 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:09.575371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:09.575386 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:09.575527 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.575535 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.576337 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.576340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.577153 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:09.577163 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.577837 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.577840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:09.577926 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.577942 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 05:00:09.578009 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 05:00:09.578089 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 05:00:09.578917 5194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4912160830d649c6a1754bed220af0eb" candidate_uuid: "5585fc20ee6d46988a9665b0327a34d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf646928cfe64bb18210d3a1d9221af6" is_pre_election: true
I20260807 05:00:09.579094 5423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4912160830d649c6a1754bed220af0eb" candidate_uuid: "5585fc20ee6d46988a9665b0327a34d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5de97a55004698805a2274c682e9bb" is_pre_election: true
I20260807 05:00:09.579272 5194 raft_consensus.cc:2454] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5585fc20ee6d46988a9665b0327a34d7 in term 0.
I20260807 05:00:09.579355 5423 raft_consensus.cc:2454] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5585fc20ee6d46988a9665b0327a34d7 in term 0.
I20260807 05:00:09.579769 5552 leader_election.cc:302] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5585fc20ee6d46988a9665b0327a34d7, cf646928cfe64bb18210d3a1d9221af6; no voters:
I20260807 05:00:09.580051 5801 raft_consensus.cc:2781] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:09.580163 5801 raft_consensus.cc:482] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:09.580300 5801 raft_consensus.cc:3037] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:09.581676 5801 raft_consensus.cc:504] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.582031 5801 leader_election.cc:288] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [CANDIDATE]: Term 1 election: Requested vote from peers cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367), 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:09.582362 5423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4912160830d649c6a1754bed220af0eb" candidate_uuid: "5585fc20ee6d46988a9665b0327a34d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5de97a55004698805a2274c682e9bb"
I20260807 05:00:09.582499 5423 raft_consensus.cc:3037] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:09.583567 5423 raft_consensus.cc:2454] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5585fc20ee6d46988a9665b0327a34d7 in term 1.
I20260807 05:00:09.583819 5194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4912160830d649c6a1754bed220af0eb" candidate_uuid: "5585fc20ee6d46988a9665b0327a34d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf646928cfe64bb18210d3a1d9221af6"
I20260807 05:00:09.583865 5553 leader_election.cc:302] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5585fc20ee6d46988a9665b0327a34d7, 8f5de97a55004698805a2274c682e9bb; no voters:
I20260807 05:00:09.583943 5194 raft_consensus.cc:3037] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:09.584020 5801 raft_consensus.cc:2781] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:09.584340 5801 raft_consensus.cc:686] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 1 LEADER]: Becoming Leader. State: Replica: 5585fc20ee6d46988a9665b0327a34d7, State: Running, Role: LEADER
I20260807 05:00:09.584697 5801 consensus_queue.cc:237] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:09.585309 5194 raft_consensus.cc:2454] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5585fc20ee6d46988a9665b0327a34d7 in term 1.
I20260807 05:00:09.588650 3687 catalog_manager.cc:5495] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "5585fc20ee6d46988a9665b0327a34d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:09.604754 5786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.601174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46972 (local address 127.25.214.195:42217)
0807 05:00:09.601289 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.601294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.601310 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:00:09.601417 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.601420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.601506 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.601599 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:09.601906 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.602449 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.603344 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.603579 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.603665 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.603928 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:09.604383 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:09.604489 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.604592 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.604645 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 05:00:09.610951 5423 raft_consensus.cc:1261] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Refusing update from remote peer 5585fc20ee6d46988a9665b0327a34d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:09.610951 5194 raft_consensus.cc:1261] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 1 FOLLOWER]: Refusing update from remote peer 5585fc20ee6d46988a9665b0327a34d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:09.611740 5801 consensus_queue.cc:1035] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:09.611949 5805 consensus_queue.cc:1035] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:09.620658 5813 mvcc.cc:205] Tried to move back new op lower bound from 7315778804158758912 to 7315778804062310400. Current Snapshot: MvccSnapshot[applied={T|T < 7315778804158758912}]
I20260807 05:00:09.623598 5810 mvcc.cc:205] Tried to move back new op lower bound from 7315778804158758912 to 7315778804062310400. Current Snapshot: MvccSnapshot[applied={T|T < 7315778804158758912}]
I20260807 05:00:09.632134 3687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:09.632315 3687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:09.636580 3687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14c8825ad0e242998179be6717077459: Sending DeleteTablet for 3 replicas of tablet 4912160830d649c6a1754bed220af0eb
I20260807 05:00:09.637378 5388 tablet_service.cc:1514] Processing DeleteTablet for tablet 4912160830d649c6a1754bed220af0eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:09 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:35214
I20260807 05:00:09.637455 5625 tablet_service.cc:1514] Processing DeleteTablet for tablet 4912160830d649c6a1754bed220af0eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:09 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:37238
I20260807 05:00:09.638108 5162 tablet_service.cc:1514] Processing DeleteTablet for tablet 4912160830d649c6a1754bed220af0eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:09 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:51750
I20260807 05:00:09.638422 5827 tablet_replica.cc:330] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: stopping tablet replica
I20260807 05:00:09.638561 5829 tablet_replica.cc:330] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: stopping tablet replica
I20260807 05:00:09.638749 5827 raft_consensus.cc:2229] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:09.638837 5829 raft_consensus.cc:2229] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:09.639148 5829 raft_consensus.cc:2258] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:09.639164 5827 raft_consensus.cc:2258] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:09.639540 5825 tablet_replica.cc:330] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: stopping tablet replica
I20260807 05:00:09.639811 5825 raft_consensus.cc:2229] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:09.640134 5825 raft_consensus.cc:2258] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:09.640865 5829 ts_tablet_manager.cc:1905] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:09.641469 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 3639
I20260807 05:00:09.650979 5825 ts_tablet_manager.cc:1905] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:09.651980 5827 ts_tablet_manager.cc:1905] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:09.654016 5825 ts_tablet_manager.cc:1918] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:09.654121 5825 log.cc:1196] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/4912160830d649c6a1754bed220af0eb
I20260807 05:00:09.654423 5825 ts_tablet_manager.cc:1939] T 4912160830d649c6a1754bed220af0eb P 8f5de97a55004698805a2274c682e9bb: Deleting consensus metadata
I20260807 05:00:09.654706 5827 ts_tablet_manager.cc:1918] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:09.654796 5827 log.cc:1196] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/4912160830d649c6a1754bed220af0eb
I20260807 05:00:09.655119 5827 ts_tablet_manager.cc:1939] T 4912160830d649c6a1754bed220af0eb P 5585fc20ee6d46988a9665b0327a34d7: Deleting consensus metadata
I20260807 05:00:09.658349 5829 ts_tablet_manager.cc:1918] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:09.658459 5829 log.cc:1196] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/4912160830d649c6a1754bed220af0eb
I20260807 05:00:09.658731 5829 ts_tablet_manager.cc:1939] T 4912160830d649c6a1754bed220af0eb P cf646928cfe64bb18210d3a1d9221af6: Deleting consensus metadata
W20260807 05:00:09.660944 5312 connection.cc:535] server connection from 127.0.0.1:35214 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 05:00:09.661340 5551 connection.cc:535] server connection from 127.0.0.1:37238 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 05:00:09.661372 5089 connection.cc:535] server connection from 127.0.0.1:51750 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 05:00:09.668452 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.639845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49086 (local address 127.25.214.253:40677)
0807 05:00:09.640073 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.640209 (+ 136us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.658921 (+ 18712us) server_negotiation.cc:407] Connection header received
0807 05:00:09.659144 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.659148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.659203 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.659254 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.660417 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.661174 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.662787 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.663117 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.663229 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.665183 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.665187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.665190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.665219 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.666776 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.667163 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.667167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.667169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.667245 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.667515 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.667518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.667520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.667706 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.667831 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.668168 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.668288 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260807 05:00:09.674762 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.665160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.25.214.252:39097)
0807 05:00:09.665286 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.665291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.665471 (+ 180us) server_negotiation.cc:407] Connection header received
0807 05:00:09.665656 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.665660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.665711 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.665791 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.666514 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.667273 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.668774 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.669116 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.669187 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.670811 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.670814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.670817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.670845 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.672427 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.673167 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.673170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.673172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.673243 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.673547 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.673551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.673553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.673767 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.673892 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.674207 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.674577 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:00:09.676239 5757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.639952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41576 (local address 127.25.214.252:39097)
0807 05:00:09.640183 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.640187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.668551 (+ 28364us) server_negotiation.cc:407] Connection header received
0807 05:00:09.668770 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.668773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.668824 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.668873 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.669687 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.670263 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.671101 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.671408 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.671487 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.672949 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.672953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.672955 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.672980 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.674423 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.675044 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.675048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.675050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.675147 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.675460 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.675463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.675465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.675646 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.675760 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.675937 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.676050 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260807 05:00:09.683982 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:09.676405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49100 (local address 127.25.214.253:40677)
0807 05:00:09.676507 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:09.676511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:09.676975 (+ 464us) server_negotiation.cc:407] Connection header received
0807 05:00:09.677010 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:09.677012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:09.677047 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:09.677106 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:09.677766 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.678220 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.679297 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:09.679603 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:09.679682 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:09.681130 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:09.681132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:09.681134 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:09.681156 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:09.682362 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.682788 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.682791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.682792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.682859 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:09.683088 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:09.683090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:09.683091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:09.683238 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:09.683350 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:09.683710 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 05:00:09.683828 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:00:10.626067 5837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:10.625072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:52517)
0807 05:00:10.625840 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:10.625948 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":90,"threads_started":1}
W20260807 05:00:10.626734 5499 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:38261 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:10.626750 5838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:10.625681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:48667)
0807 05:00:10.626418 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:10.626649 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":70,"threads_started":1}
W20260807 05:00:10.627084 5267 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:38261 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:10.627424 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:10.626050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:53751)
0807 05:00:10.627269 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:10.627338 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1154,"thread_start_us":75,"threads_started":1}
W20260807 05:00:10.627665 5732 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:38261 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:11.136772 5840 raft_consensus.cc:482] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14c8825ad0e242998179be6717077459)
I20260807 05:00:11.137023 5840 raft_consensus.cc:504] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } }
I20260807 05:00:11.138247 5840 leader_election.cc:288] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14c8825ad0e242998179be6717077459 (127.25.214.254:38261), 170c6ff09b204c67af5ee2778565c3cf (127.25.214.253:40677)
I20260807 05:00:11.138935 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.138361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45550)
0807 05:00:11.138713 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.138813 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":86,"threads_started":1}
W20260807 05:00:11.139160 4957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:11.139273 5841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14c8825ad0e242998179be6717077459)
I20260807 05:00:11.139470 5841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } }
I20260807 05:00:11.140324 5844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.140024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45564)
0807 05:00:11.140188 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.140244 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260807 05:00:11.140507 4957 leader_election.cc:334] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 14c8825ad0e242998179be6717077459 (127.25.214.254:38261): Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:11.140988 5841 leader_election.cc:288] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14c8825ad0e242998179be6717077459 (127.25.214.254:38261), adf174d1211841bc9c0d43f14be037b8 (127.25.214.252:39097)
I20260807 05:00:11.141348 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.140699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45566)
0807 05:00:11.140916 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.140985 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":72,"threads_started":1}
W20260807 05:00:11.141573 4656 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:11.142522 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.142239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45572)
0807 05:00:11.142410 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.142458 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260807 05:00:11.142623 4656 leader_election.cc:334] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 14c8825ad0e242998179be6717077459 (127.25.214.254:38261): Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:11.143319 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.138560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:40677 (local address 127.0.0.1:49110)
0807 05:00:11.139083 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.139097 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.139204 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.139679 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.139682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.139710 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.139817 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.139822 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.140896 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.140900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.142029 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.142043 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.142941 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.142946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.143045 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.143070 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.143131 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.143194 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":52,"threads_started":1}
I20260807 05:00:11.143321 5845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.138839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49110 (local address 127.25.214.253:40677)
0807 05:00:11.139439 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.139443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.139456 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:11.139505 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.139508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.139553 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.139936 (+ 383us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.140045 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.140780 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.142168 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.142807 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.142996 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.143055 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.143151 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.143229 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":80,"threads_started":1}
I20260807 05:00:11.143885 4688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "adf174d1211841bc9c0d43f14be037b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "170c6ff09b204c67af5ee2778565c3cf" is_pre_election: true
I20260807 05:00:11.144127 4688 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf174d1211841bc9c0d43f14be037b8 in term 1.
I20260807 05:00:11.144479 4955 leader_election.cc:302] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 170c6ff09b204c67af5ee2778565c3cf, adf174d1211841bc9c0d43f14be037b8; no voters: 14c8825ad0e242998179be6717077459
I20260807 05:00:11.144727 5840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 05:00:11.144798 5840 raft_consensus.cc:482] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14c8825ad0e242998179be6717077459)
I20260807 05:00:11.144850 5840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 1 FOLLOWER]: Advancing to term 2
I20260807 05:00:11.145401 5850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.141173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:39097 (local address 127.0.0.1:41600)
0807 05:00:11.141426 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.141439 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.141528 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.142006 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.142009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.142026 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.142113 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.142119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.143248 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.143252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.144309 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.144319 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.145092 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.145095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.145168 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.145189 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.145253 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.145308 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
I20260807 05:00:11.145480 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.141530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.25.214.252:39097)
0807 05:00:11.141774 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.141783 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.141797 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:11.141837 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.141840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.141883 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.142212 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.142297 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.143105 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.144419 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.144976 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.145095 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.145143 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.145285 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.145351 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":91,"threads_started":1}
I20260807 05:00:11.145882 4986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "170c6ff09b204c67af5ee2778565c3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "adf174d1211841bc9c0d43f14be037b8" is_pre_election: true
I20260807 05:00:11.146190 5840 raft_consensus.cc:504] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } }
I20260807 05:00:11.146437 4986 raft_consensus.cc:2379] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 170c6ff09b204c67af5ee2778565c3cf in current term 2: Already voted for candidate adf174d1211841bc9c0d43f14be037b8 in this term.
I20260807 05:00:11.146593 5840 leader_election.cc:288] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [CANDIDATE]: Term 2 election: Requested vote from peers 14c8825ad0e242998179be6717077459 (127.25.214.254:38261), 170c6ff09b204c67af5ee2778565c3cf (127.25.214.253:40677)
I20260807 05:00:11.146982 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.146691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45576)
0807 05:00:11.146850 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.146917 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 05:00:11.146955 4688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "adf174d1211841bc9c0d43f14be037b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "170c6ff09b204c67af5ee2778565c3cf"
I20260807 05:00:11.147032 4656 leader_election.cc:302] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 170c6ff09b204c67af5ee2778565c3cf; no voters: 14c8825ad0e242998179be6717077459, adf174d1211841bc9c0d43f14be037b8
I20260807 05:00:11.147061 4688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 1 FOLLOWER]: Advancing to term 2
I20260807 05:00:11.147702 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.147512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45582)
0807 05:00:11.147607 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.147652 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 05:00:11.147809 4957 leader_election.cc:334] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 14c8825ad0e242998179be6717077459 (127.25.214.254:38261): Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
I20260807 05:00:11.148270 4688 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf174d1211841bc9c0d43f14be037b8 in term 2.
I20260807 05:00:11.148382 5841 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:00:11.148551 4955 leader_election.cc:302] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 170c6ff09b204c67af5ee2778565c3cf, adf174d1211841bc9c0d43f14be037b8; no voters: 14c8825ad0e242998179be6717077459
I20260807 05:00:11.148713 5840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 05:00:11.148957 5840 raft_consensus.cc:686] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [term 2 LEADER]: Becoming Leader. State: Replica: adf174d1211841bc9c0d43f14be037b8, State: Running, Role: LEADER
I20260807 05:00:11.149215 5840 consensus_queue.cc:237] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } }
I20260807 05:00:11.150516 5855 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adf174d1211841bc9c0d43f14be037b8. Latest consensus state: current_term: 2 leader_uuid: "adf174d1211841bc9c0d43f14be037b8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:11.150619 5855 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:11.150864 5859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:11.153357 5859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:11.153767 5859 catalog_manager.cc:1259] Loaded cluster ID: 58ec4e9a9dd6469e87fe9651cbf2c408
I20260807 05:00:11.153817 5859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:11.154363 5859 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:11.154745 5859 catalog_manager.cc:5879] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Loaded TSK: 0
I20260807 05:00:11.155484 5859 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:00:11.199574 4964 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41584:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:11.202776 4964 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:11.205902 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.205644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45600)
0807 05:00:11.205752 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.205815 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 05:00:11.206063 4688 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [term 2 FOLLOWER]: Refusing update from remote peer adf174d1211841bc9c0d43f14be037b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 05:00:11.206616 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.206381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.0.0.1:45606)
0807 05:00:11.206495 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.206550 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 05:00:11.206619 5855 consensus_queue.cc:1035] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 05:00:11.206836 4957 consensus_peers.cc:487] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 -> Peer 14c8825ad0e242998179be6717077459 (127.25.214.254:38261): Couldn't send request to peer 14c8825ad0e242998179be6717077459. Status: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 05:00:11.208177 5841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader adf174d1211841bc9c0d43f14be037b8. Latest consensus state: current_term: 2 leader_uuid: "adf174d1211841bc9c0d43f14be037b8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:11.208310 5841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:11.209542 5840 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "adf174d1211841bc9c0d43f14be037b8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:11.209671 5840 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:11.210108 5841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "adf174d1211841bc9c0d43f14be037b8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "14c8825ad0e242998179be6717077459" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38261 } } peers { permanent_uuid: "170c6ff09b204c67af5ee2778565c3cf" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 40677 } attrs { promote: false } } peers { permanent_uuid: "adf174d1211841bc9c0d43f14be037b8" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 39097 } attrs { promote: false } } }
I20260807 05:00:11.210237 5841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 170c6ff09b204c67af5ee2778565c3cf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:00:11.220263 5843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.215986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:42217 (local address 127.0.0.1:46980)
0807 05:00:11.216169 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.216184 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.216263 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.216678 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.216682 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.216704 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.216814 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.216820 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.217886 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.217888 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.218973 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.218982 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.219804 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.219808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.219907 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.219935 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.220013 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.220119 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 05:00:11.220319 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.216071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46980 (local address 127.25.214.195:42217)
0807 05:00:11.216410 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.216414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.216428 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:11.216495 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.216498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.216551 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.216925 (+ 374us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.217048 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.217784 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.219095 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.219685 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.219801 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.219858 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.220036 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.220170 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":114,"threads_started":1}
I20260807 05:00:11.220577 5844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.216603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:44367 (local address 127.0.0.1:44612)
0807 05:00:11.216842 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.216854 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.216924 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.217589 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.217593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.217620 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.217709 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.217714 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.218499 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.218502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.219325 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.219335 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.220200 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.220204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.220303 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.220327 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.220377 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.220460 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":3,"spinlock_wait_cycles":768}
I20260807 05:00:11.220934 5625 tablet_service.cc:1467] Processing CreateTablet for tablet 58b5ce20b6de43339190662d683120f3 (DEFAULT_TABLE table=test-table [id=2a5049a3791d418e88c5ea340e8e37d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:11.221272 5625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b5ce20b6de43339190662d683120f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:11.221333 5876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.217088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44612 (local address 127.25.214.193:44367)
0807 05:00:11.217352 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.217357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.217370 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:11.217419 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.217423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.217468 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.217802 (+ 334us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.217908 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.218385 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.219479 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.220038 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.221070 (+ 1032us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.221127 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.221164 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.221224 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":96,"threads_started":1}
I20260807 05:00:11.221580 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.216885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40341 (local address 127.0.0.1:52958)
0807 05:00:11.217248 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.217261 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.217356 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.217576 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.217578 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.217593 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.217702 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.217708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.219271 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.219273 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.220259 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.220269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.221208 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.221212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.221294 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.221317 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.221395 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.221463 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"spinlock_wait_cycles":7808,"thread_start_us":107,"threads_started":1}
I20260807 05:00:11.221807 5162 tablet_service.cc:1467] Processing CreateTablet for tablet 58b5ce20b6de43339190662d683120f3 (DEFAULT_TABLE table=test-table [id=2a5049a3791d418e88c5ea340e8e37d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:11.221930 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.217015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52958 (local address 127.25.214.194:40341)
0807 05:00:11.217234 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.217239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.217318 (+ 79us) server_negotiation.cc:407] Connection header received
0807 05:00:11.217442 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.217445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.217490 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.217560 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.217804 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.218587 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.220421 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.220981 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.221095 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.221145 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.221727 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.221810 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":72,"threads_started":1}
I20260807 05:00:11.222077 5162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b5ce20b6de43339190662d683120f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:11.223634 5877 tablet_bootstrap.cc:492] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Bootstrap starting.
I20260807 05:00:11.224408 5878 tablet_bootstrap.cc:492] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: Bootstrap starting.
I20260807 05:00:11.224437 5388 tablet_service.cc:1467] Processing CreateTablet for tablet 58b5ce20b6de43339190662d683120f3 (DEFAULT_TABLE table=test-table [id=2a5049a3791d418e88c5ea340e8e37d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:11.224697 5388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b5ce20b6de43339190662d683120f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:11.225312 5878 tablet_bootstrap.cc:654] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:11.226579 5878 tablet_bootstrap.cc:492] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: No bootstrap required, opened a new log
I20260807 05:00:11.226681 5878 ts_tablet_manager.cc:1397] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:11.227152 5878 raft_consensus.cc:348] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.227272 5878 raft_consensus.cc:374] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:11.227257 5882 tablet_bootstrap.cc:492] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Bootstrap starting.
I20260807 05:00:11.227303 5878 raft_consensus.cc:729] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf646928cfe64bb18210d3a1d9221af6, State: Initialized, Role: FOLLOWER
I20260807 05:00:11.227474 5878 consensus_queue.cc:260] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.227671 5877 tablet_bootstrap.cc:654] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:11.227823 5878 ts_tablet_manager.cc:1428] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 05:00:11.228257 5882 tablet_bootstrap.cc:654] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:11.229238 5877 tablet_bootstrap.cc:492] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: No bootstrap required, opened a new log
I20260807 05:00:11.229327 5877 ts_tablet_manager.cc:1397] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260807 05:00:11.229769 5877 raft_consensus.cc:348] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.229910 5877 raft_consensus.cc:374] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:11.229954 5877 raft_consensus.cc:729] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5585fc20ee6d46988a9665b0327a34d7, State: Initialized, Role: FOLLOWER
I20260807 05:00:11.230082 5877 consensus_queue.cc:260] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.230420 5877 ts_tablet_manager.cc:1428] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260807 05:00:11.231132 5894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.230734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:49385)
0807 05:00:11.230968 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.231037 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260807 05:00:11.231600 5268 heartbeater.cc:503] Master 127.25.214.252:39097 was elected leader, sending a full tablet report...
I20260807 05:00:11.232955 5882 tablet_bootstrap.cc:492] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: No bootstrap required, opened a new log
I20260807 05:00:11.233047 5882 ts_tablet_manager.cc:1397] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 05:00:11.233467 5894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.232474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:53891)
0807 05:00:11.233350 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.233404 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":803}
I20260807 05:00:11.233827 5882 raft_consensus.cc:348] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.233923 5889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.228428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:54269)
0807 05:00:11.233790 (+ 5362us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.233839 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5298,"thread_start_us":151,"threads_started":1}
I20260807 05:00:11.233948 5882 raft_consensus.cc:374] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:11.233981 5882 raft_consensus.cc:729] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f5de97a55004698805a2274c682e9bb, State: Initialized, Role: FOLLOWER
I20260807 05:00:11.234146 5882 consensus_queue.cc:260] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.234520 5882 ts_tablet_manager.cc:1428] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 05:00:11.234555 5889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.234356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:60151)
0807 05:00:11.234452 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.234502 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 05:00:11.235653 5896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.235189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:41441)
0807 05:00:11.235489 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.235548 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":150,"threads_started":1}
I20260807 05:00:11.236896 5500 heartbeater.cc:503] Master 127.25.214.252:39097 was elected leader, sending a full tablet report...
I20260807 05:00:11.237329 5896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.237053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:60475)
0807 05:00:11.237187 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.237252 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 05:00:11.247162 5271 tablet.cc:2369] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:00:11.310075 5884 raft_consensus.cc:482] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:11.310267 5884 raft_consensus.cc:504] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.311431 5884 leader_election.cc:288] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217), 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:11.315274 5889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.311701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:42217 (local address 127.25.214.193:50789)
0807 05:00:11.311854 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.311872 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.312005 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.312327 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.312330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.312350 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.312449 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.312454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.313210 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.313214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.314076 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.314087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.314858 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.314862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.314947 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.314975 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.315057 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.315148 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 05:00:11.315305 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.311832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50789 (local address 127.25.214.195:42217)
0807 05:00:11.311969 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.311973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.311990 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:00:11.312167 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.312170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.312228 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.312312 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.312575 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.313099 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.314218 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.314713 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.314807 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.314850 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.315092 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.315171 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:00:11.315475 5897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.311992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:40341 (local address 127.25.214.193:59137)
0807 05:00:11.312330 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.312343 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:11.312459 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:11.312680 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:11.312683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:11.312698 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:11.312811 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.312816 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.313544 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.313547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.314343 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:11.314354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.315029 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.315033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:11.315154 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.315176 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 05:00:11.315253 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 05:00:11.315314 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":1,"thread_start_us":171,"threads_started":1}
I20260807 05:00:11.315698 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.312165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:59137 (local address 127.25.214.194:40341)
0807 05:00:11.312307 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.312312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.312421 (+ 109us) server_negotiation.cc:407] Connection header received
0807 05:00:11.312550 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.312554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.312596 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.312661 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:11.312929 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.313433 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.314471 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.314913 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.315032 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.315094 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.315277 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.315473 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 05:00:11.316033 5657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5ce20b6de43339190662d683120f3" candidate_uuid: "cf646928cfe64bb18210d3a1d9221af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5585fc20ee6d46988a9665b0327a34d7" is_pre_election: true
I20260807 05:00:11.316169 5423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5ce20b6de43339190662d683120f3" candidate_uuid: "cf646928cfe64bb18210d3a1d9221af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5de97a55004698805a2274c682e9bb" is_pre_election: true
I20260807 05:00:11.316311 5423 raft_consensus.cc:2454] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf646928cfe64bb18210d3a1d9221af6 in term 0.
I20260807 05:00:11.316316 5657 raft_consensus.cc:2454] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf646928cfe64bb18210d3a1d9221af6 in term 0.
I20260807 05:00:11.316680 5089 leader_election.cc:302] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f5de97a55004698805a2274c682e9bb, cf646928cfe64bb18210d3a1d9221af6; no voters:
I20260807 05:00:11.316919 5884 raft_consensus.cc:2781] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:11.316983 5884 raft_consensus.cc:482] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:11.317035 5884 raft_consensus.cc:3037] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:11.318051 5884 raft_consensus.cc:504] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.318367 5884 leader_election.cc:288] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [CANDIDATE]: Term 1 election: Requested vote from peers 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217), 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341)
I20260807 05:00:11.318792 5657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5ce20b6de43339190662d683120f3" candidate_uuid: "cf646928cfe64bb18210d3a1d9221af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5585fc20ee6d46988a9665b0327a34d7"
I20260807 05:00:11.318792 5423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5ce20b6de43339190662d683120f3" candidate_uuid: "cf646928cfe64bb18210d3a1d9221af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5de97a55004698805a2274c682e9bb"
I20260807 05:00:11.318912 5423 raft_consensus.cc:3037] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:11.318912 5657 raft_consensus.cc:3037] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:11.320022 5423 raft_consensus.cc:2454] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf646928cfe64bb18210d3a1d9221af6 in term 1.
I20260807 05:00:11.320024 5657 raft_consensus.cc:2454] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf646928cfe64bb18210d3a1d9221af6 in term 1.
I20260807 05:00:11.320343 5089 leader_election.cc:302] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5585fc20ee6d46988a9665b0327a34d7, cf646928cfe64bb18210d3a1d9221af6; no voters:
I20260807 05:00:11.320503 5884 raft_consensus.cc:2781] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:11.320721 5884 raft_consensus.cc:686] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 1 LEADER]: Becoming Leader. State: Replica: cf646928cfe64bb18210d3a1d9221af6, State: Running, Role: LEADER
I20260807 05:00:11.321159 5884 consensus_queue.cc:237] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } }
I20260807 05:00:11.321389 5897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.321154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:49345)
0807 05:00:11.321265 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.321318 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 05:00:11.323693 4976 catalog_manager.cc:5495] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "cf646928cfe64bb18210d3a1d9221af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf646928cfe64bb18210d3a1d9221af6" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:11.354892 5876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.351616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.25.214.193:44367)
0807 05:00:11.351737 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:11.351741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:11.351755 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:11.351850 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:11.351852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:11.351907 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:11.351998 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:11.352226 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.352739 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.353564 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:11.353782 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:11.353882 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:11.354122 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:11.354586 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:11.354684 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:11.354714 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 05:00:11.354765 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:00:11.357803 5423 raft_consensus.cc:1261] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Refusing update from remote peer cf646928cfe64bb18210d3a1d9221af6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:11.358029 5657 raft_consensus.cc:1261] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Refusing update from remote peer cf646928cfe64bb18210d3a1d9221af6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:11.358337 5899 consensus_queue.cc:1035] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f5de97a55004698805a2274c682e9bb" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:11.358579 5884 consensus_queue.cc:1035] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5585fc20ee6d46988a9665b0327a34d7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:11.359907 5735 heartbeater.cc:503] Master 127.25.214.252:39097 was elected leader, sending a full tablet report...
I20260807 05:00:11.360544 5894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.360317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:40289)
0807 05:00:11.360406 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.360465 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 05:00:11.360692 5896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.360402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:57275)
0807 05:00:11.360566 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.360620 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 05:00:11.363314 5897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.363100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:53011)
0807 05:00:11.363190 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.363243 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 05:00:11.366667 5896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.366124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.194:34091)
0807 05:00:11.366529 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.366597 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340}
I20260807 05:00:11.367342 5907 mvcc.cc:205] Tried to move back new op lower bound from 7315778811316318208 to 7315778811174121472. Current Snapshot: MvccSnapshot[applied={T|T < 7315778811316318208}]
I20260807 05:00:11.368043 5897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.367809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.193:37271)
0807 05:00:11.367924 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.367978 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 05:00:11.370539 5894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.365923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38261 (local address 127.25.214.195:51259)
0807 05:00:11.370418 (+ 4495us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.370474 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4419}
I20260807 05:00:11.371227 4976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:11.371387 4976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:11.375201 4976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P adf174d1211841bc9c0d43f14be037b8: Sending DeleteTablet for 3 replicas of tablet 58b5ce20b6de43339190662d683120f3
I20260807 05:00:11.375831 5625 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b5ce20b6de43339190662d683120f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:11 UTC) from {username='oryx', principal='oryx/127.25.214.252@KRBTEST.COM'} at 127.0.0.1:46980
I20260807 05:00:11.375881 5162 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b5ce20b6de43339190662d683120f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:11 UTC) from {username='oryx', principal='oryx/127.25.214.252@KRBTEST.COM'} at 127.0.0.1:44612
I20260807 05:00:11.376423 5388 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b5ce20b6de43339190662d683120f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:11 UTC) from {username='oryx', principal='oryx/127.25.214.252@KRBTEST.COM'} at 127.0.0.1:52958
I20260807 05:00:11.376484 5925 tablet_replica.cc:330] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: stopping tablet replica
I20260807 05:00:11.376619 5925 raft_consensus.cc:2229] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:11.376756 5925 raft_consensus.cc:2258] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:11.376981 5926 tablet_replica.cc:330] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: stopping tablet replica
I20260807 05:00:11.376989 5920 tablet_replica.cc:330] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6: stopping tablet replica
I20260807 05:00:11.377108 5920 raft_consensus.cc:2229] T 58b5ce20b6de43339190662d683120f3 P cf646928cfe64bb18210d3a1d9221af6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:11.377157 5926 raft_consensus.cc:2229] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:11.377283 5926 raft_consensus.cc:2258] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:11.377295 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 4916
I20260807 05:00:11.385408 5925 ts_tablet_manager.cc:1905] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:11.387593 5925 ts_tablet_manager.cc:1918] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:11.387670 5925 log.cc:1196] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/58b5ce20b6de43339190662d683120f3
I20260807 05:00:11.387924 5925 ts_tablet_manager.cc:1939] T 58b5ce20b6de43339190662d683120f3 P 5585fc20ee6d46988a9665b0327a34d7: Deleting consensus metadata
I20260807 05:00:11.388720 4957 catalog_manager.cc:4841] TS 5585fc20ee6d46988a9665b0327a34d7 (127.25.214.195:42217): tablet 58b5ce20b6de43339190662d683120f3 (table test-table [id=2a5049a3791d418e88c5ea340e8e37d1]) successfully deleted
I20260807 05:00:11.388765 5926 ts_tablet_manager.cc:1905] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:11.391304 5926 ts_tablet_manager.cc:1918] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:11.391417 5926 log.cc:1196] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/58b5ce20b6de43339190662d683120f3
I20260807 05:00:11.391659 5926 ts_tablet_manager.cc:1939] T 58b5ce20b6de43339190662d683120f3 P 8f5de97a55004698805a2274c682e9bb: Deleting consensus metadata
I20260807 05:00:11.392373 4957 catalog_manager.cc:4841] TS 8f5de97a55004698805a2274c682e9bb (127.25.214.194:40341): tablet 58b5ce20b6de43339190662d683120f3 (table test-table [id=2a5049a3791d418e88c5ea340e8e37d1]) successfully deleted
I20260807 05:00:11.395000 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 5277
I20260807 05:00:11.395325 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:11.395053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:44367 (local address 127.0.0.1:44636)
0807 05:00:11.395185 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:11.395237 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:44367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 05:00:11.405019 4956 catalog_manager.cc:4584] TS cf646928cfe64bb18210d3a1d9221af6 (127.25.214.193:44367): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 58b5ce20b6de43339190662d683120f3: Network error: Client connection negotiation failed: client connection to 127.25.214.193:44367: connect: Connection refused (error 111)
I20260807 05:00:11.410471 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 5511
I20260807 05:00:11.422726 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 4441
I20260807 05:00:11.433992 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 4632
2026-08-07T05:00:11Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5562 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:11 dist-test-slave-lgr5 krb5kdc[5930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:11 dist-test-slave-lgr5 krb5kdc[5930](info): set up 2 sockets
Aug 07 05:00:11 dist-test-slave-lgr5 krb5kdc[5930](info): commencing operation
krb5kdc: starting...
W20260807 05:00:12.584314 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:12 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:12Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab.
Entry for principal oryx/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab.
I20260807 05:00:12.703718 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42263
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab
--principal=oryx/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:42263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:12.815611 5951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:12.815900 5951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:12.815940 5951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:12.820139 5951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:12.820206 5951 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 05:00:12.820222 5951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:12.820240 5951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:12.820258 5951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:12.820286 5951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:12.825803 5951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:42263
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.254.keytab
--principal=oryx/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:12.826957 5951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:12.828035 5951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:12.836550 5963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:12.836555 5964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:12.836550 5967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:12.836593 5951 server_base.cc:1034] running on GCE node
I20260807 05:00:12.837296 5951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:12.838366 5951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:12.839530 5951 hybrid_clock.cc:648] HybridClock initialized: now 1786078812839516 us; error 27 us; skew 500 ppm
Aug 07 05:00:12 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078812, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:12.844954 5951 init.cc:377] Logged in from keytab as oryx/127.25.214.254@KRBTEST.COM (short username oryx)
I20260807 05:00:12.845827 5951 webserver.cc:460] Webserver started at http://127.25.214.254:34519/ using document root <none> and password file <none>
I20260807 05:00:12.846365 5951 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:12.846436 5951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:12.846653 5951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:12.848742 5951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "f71000b995dd412aa86beaf9f3b0e103"
format_stamp: "Formatted at 2026-08-07 05:00:12 on dist-test-slave-lgr5"
server_key: "11bc39cc2b5d0cc06195cff96db49963"
server_key_iv: "5b5f4efffa42628955e5baff9fe2028f"
server_key_version: "encryptionkey@0"
I20260807 05:00:12.849324 5951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "f71000b995dd412aa86beaf9f3b0e103"
format_stamp: "Formatted at 2026-08-07 05:00:12 on dist-test-slave-lgr5"
server_key: "11bc39cc2b5d0cc06195cff96db49963"
server_key_iv: "5b5f4efffa42628955e5baff9fe2028f"
server_key_version: "encryptionkey@0"
I20260807 05:00:12.852991 5951 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:00:12.855247 5978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:12.856465 5951 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:12.856583 5951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "f71000b995dd412aa86beaf9f3b0e103"
format_stamp: "Formatted at 2026-08-07 05:00:12 on dist-test-slave-lgr5"
server_key: "11bc39cc2b5d0cc06195cff96db49963"
server_key_iv: "5b5f4efffa42628955e5baff9fe2028f"
server_key_version: "encryptionkey@0"
I20260807 05:00:12.856676 5951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:12.865712 5951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:12.868577 5951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:12.868748 5951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:12.876071 5951 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:42263
I20260807 05:00:12.876102 6074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:42263 every 8 connection(s)
I20260807 05:00:12.877005 5951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:12.879673 6075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:12.879913 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 5951
I20260807 05:00:12.880023 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:12.880332 26459 external_mini_cluster.cc:1428] Setting key 3b9613e6017726ea4bbfe5d3479eb349
I20260807 05:00:12.886289 6075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Bootstrap starting.
I20260807 05:00:12.888912 6075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Neither blocks nor log segments found. Creating new log.
Aug 07 05:00:12 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:12.889727 6075 log.cc:824] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:12.891994 6075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: No bootstrap required, opened a new log
I20260807 05:00:12.895141 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:12.881659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51476 (local address 127.25.214.254:42263)
0807 05:00:12.882050 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:12.882066 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:12.882100 (+ 34us) server_negotiation.cc:407] Connection header received
0807 05:00:12.882764 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:12.882781 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:12.883096 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:12.883363 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:12.884255 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:12.885237 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:12.886356 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:12.886847 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:12.886965 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:12.889628 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:12.889635 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:12.889651 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:12.889683 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:12.892220 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:12.892624 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:12.892629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:12.892635 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:12.892769 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:12.892990 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:12.892994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:12.892996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:12.893478 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:12.893676 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:12.893868 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 05:00:12.894166 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":125,"threads_started":1}
I20260807 05:00:12.895839 6075 raft_consensus.cc:348] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71000b995dd412aa86beaf9f3b0e103" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42263 } }
I20260807 05:00:12.896159 6075 raft_consensus.cc:374] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:12.896216 6075 raft_consensus.cc:729] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f71000b995dd412aa86beaf9f3b0e103, State: Initialized, Role: FOLLOWER
I20260807 05:00:12.896616 6075 consensus_queue.cc:260] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71000b995dd412aa86beaf9f3b0e103" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42263 } }
I20260807 05:00:12.896724 6075 raft_consensus.cc:388] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:12.896762 6075 raft_consensus.cc:482] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:12.896824 6075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:12.897789 6075 raft_consensus.cc:504] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71000b995dd412aa86beaf9f3b0e103" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42263 } }
I20260807 05:00:12.898090 6075 leader_election.cc:302] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f71000b995dd412aa86beaf9f3b0e103; no voters:
I20260807 05:00:12.898345 6075 leader_election.cc:288] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:12.898487 6082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:12.898702 6082 raft_consensus.cc:686] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [term 1 LEADER]: Becoming Leader. State: Replica: f71000b995dd412aa86beaf9f3b0e103, State: Running, Role: LEADER
I20260807 05:00:12.898994 6082 consensus_queue.cc:237] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71000b995dd412aa86beaf9f3b0e103" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42263 } }
I20260807 05:00:12.899487 6075 sys_catalog.cc:564] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:12.900679 6087 sys_catalog.cc:455] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f71000b995dd412aa86beaf9f3b0e103. Latest consensus state: current_term: 1 leader_uuid: "f71000b995dd412aa86beaf9f3b0e103" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71000b995dd412aa86beaf9f3b0e103" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42263 } } }
I20260807 05:00:12.900660 6083 sys_catalog.cc:455] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f71000b995dd412aa86beaf9f3b0e103" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71000b995dd412aa86beaf9f3b0e103" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42263 } } }
I20260807 05:00:12.900812 6087 sys_catalog.cc:458] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:12.900820 6083 sys_catalog.cc:458] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:12.901237 6098 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:12.904421 6098 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:12.909833 6098 catalog_manager.cc:1347] Generated new cluster ID: b779dd1199f74fa983e1b98cabce9227
I20260807 05:00:12.909891 6098 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:12.921962 6098 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:12.922787 6098 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:12.935197 6098 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Generated new TSK 0
I20260807 05:00:12.935999 6098 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab.
Entry for principal oryx/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab.
I20260807 05:00:12.972786 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42263
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:13.085189 6112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:13.085464 6112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:13.085527 6112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:13.089576 6112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:13.089641 6112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:13.089697 6112 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 05:00:13.089756 6112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:13.095106 6112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:13.096257 6112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:13.097296 6112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:00:13.106855 6112 server_base.cc:1034] running on GCE node
W20260807 05:00:13.106808 6126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:13.106844 6122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:13.106808 6128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:13.107465 6112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:13.108107 6112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:13.109272 6112 hybrid_clock.cc:648] HybridClock initialized: now 1786078813109252 us; error 40 us; skew 500 ppm
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:13.111873 6112 init.cc:377] Logged in from keytab as oryx/127.25.214.193@KRBTEST.COM (short username oryx)
I20260807 05:00:13.112732 6112 webserver.cc:460] Webserver started at http://127.25.214.193:36121/ using document root <none> and password file <none>
I20260807 05:00:13.113251 6112 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:13.113315 6112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:13.113536 6112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:13.115593 6112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "08a8a44f333a44b198319c45f06abb0c"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "8f4a92660358793918014e4327c3b9a6"
server_key_iv: "e221242d1b5c36e3f720dde5cfdc12ac"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.116165 6112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "08a8a44f333a44b198319c45f06abb0c"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "8f4a92660358793918014e4327c3b9a6"
server_key_iv: "e221242d1b5c36e3f720dde5cfdc12ac"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.119782 6112 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:00:13.122155 6136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:13.123319 6112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:13.123430 6112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "08a8a44f333a44b198319c45f06abb0c"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "8f4a92660358793918014e4327c3b9a6"
server_key_iv: "e221242d1b5c36e3f720dde5cfdc12ac"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.123539 6112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:13.134315 6112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:13.137250 6112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:13.137421 6112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:13.138867 6112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:13.138918 6112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:13.138973 6112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:13.138998 6112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:13.148857 6112 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:42085
I20260807 05:00:13.148923 6334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:42085 every 8 connection(s)
I20260807 05:00:13.149859 6112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:13.151981 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.139574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:34529 (local address 127.25.214.254:42263)
0807 05:00:13.139714 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.139720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.140621 (+ 901us) server_negotiation.cc:407] Connection header received
0807 05:00:13.141710 (+ 1089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.141714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.141770 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.141851 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.143383 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.144234 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.145580 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.145814 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.145907 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.148711 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.148715 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.148718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.148748 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.150147 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.150710 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.150714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.150715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.150817 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.151114 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.151116 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.151117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.151290 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.151363 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.151753 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.151855 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:00:13.152786 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.139963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.25.214.193:34529)
0807 05:00:13.140447 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.140497 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.141473 (+ 976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.142084 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.142094 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.142528 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.143207 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.143229 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.144391 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.144394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.145451 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.145462 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.145961 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.145965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.146146 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.146702 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.146717 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.148520 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.150279 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.150285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.150298 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.150618 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.150905 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.150907 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.150909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.151041 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.151360 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.151365 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.151576 (+ 211us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.151718 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.151946 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":147,"threads_started":1}
I20260807 05:00:13.153923 6335 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42263
I20260807 05:00:13.154052 6335 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:13.154515 6335 heartbeater.cc:511] Master 127.25.214.254:42263 requested a full tablet report, sending...
I20260807 05:00:13.156035 6005 ts_manager.cc:194] Registered new tserver with Master: 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085)
I20260807 05:00:13.157490 6005 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:34529
I20260807 05:00:13.159480 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 6112
I20260807 05:00:13.159641 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:13.159927 26459 external_mini_cluster.cc:1428] Setting key a560b84c29725313322b64690de9938c
I20260807 05:00:13.162948 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.155932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.25.214.193:54145)
0807 05:00:13.156248 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.156260 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.156342 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.156546 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.156548 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.156699 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.156787 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.156792 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.157728 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.157731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.158343 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.158354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.158775 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.158778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.158875 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.159349 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.159363 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.159841 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.161631 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.161634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.161635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.161822 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.162099 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.162101 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.162103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.162173 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.162530 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.162532 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.162608 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.162682 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.162787 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260807 05:00:13.163000 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.156007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:54145 (local address 127.25.214.254:42263)
0807 05:00:13.156150 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.156155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.156324 (+ 169us) server_negotiation.cc:407] Connection header received
0807 05:00:13.156416 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.156419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.156458 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.156522 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.156885 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.157615 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.158453 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.158669 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.158743 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.159991 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.159995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.159998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.160032 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.161528 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.161910 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.161914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.161916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.162003 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.162243 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.162246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.162247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.162453 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.162549 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.162742 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.162856 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
WARNING: no policy specified for oryx/127.25.214.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab.
Entry for principal oryx/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab.
I20260807 05:00:13.186707 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42263
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:13.296387 6346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:13.296646 6346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:13.296707 6346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:13.300690 6346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:13.300743 6346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:13.300796 6346 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 05:00:13.300848 6346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:13.306041 6346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:13.307137 6346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:13.308276 6346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:13.317657 6355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:13.317657 6354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:13.317711 6357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:13.317780 6346 server_base.cc:1034] running on GCE node
I20260807 05:00:13.318338 6346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:13.318899 6346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:13.320051 6346 hybrid_clock.cc:648] HybridClock initialized: now 1786078813320031 us; error 38 us; skew 500 ppm
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:13.322582 6346 init.cc:377] Logged in from keytab as oryx/127.25.214.194@KRBTEST.COM (short username oryx)
I20260807 05:00:13.323342 6346 webserver.cc:460] Webserver started at http://127.25.214.194:41405/ using document root <none> and password file <none>
I20260807 05:00:13.323837 6346 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:13.323890 6346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:13.324049 6346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:13.326007 6346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "c71a4bba66b44bfab29663ff20bb96f8"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "136fa0a330be06ec1afb07f7764e3dbc"
server_key_iv: "c20399eda75430cefed9da2f7ff0d301"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.326514 6346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "c71a4bba66b44bfab29663ff20bb96f8"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "136fa0a330be06ec1afb07f7764e3dbc"
server_key_iv: "c20399eda75430cefed9da2f7ff0d301"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.330009 6346 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 05:00:13.332232 6367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:13.333307 6346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:13.333402 6346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "c71a4bba66b44bfab29663ff20bb96f8"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "136fa0a330be06ec1afb07f7764e3dbc"
server_key_iv: "c20399eda75430cefed9da2f7ff0d301"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.333492 6346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:13.362584 6346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:13.365393 6346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:13.365569 6346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:13.366928 6346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:13.366977 6346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:13.367029 6346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:13.367059 6346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:13.377209 6346 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:36493
I20260807 05:00:13.377313 6552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:36493 every 8 connection(s)
I20260807 05:00:13.378213 6346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:13.380577 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.367702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:54239 (local address 127.25.214.254:42263)
0807 05:00:13.367822 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.367826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.368922 (+ 1096us) server_negotiation.cc:407] Connection header received
0807 05:00:13.369966 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.369970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.370039 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.370107 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.371956 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.372792 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.374185 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.374487 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.374586 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.377238 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.377242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.377244 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.377275 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.378578 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.379123 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.379127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.379129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.379212 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.379521 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.379524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.379526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.379703 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.379790 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.380284 (+ 494us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.380403 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 05:00:13.381309 6385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.368243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.25.214.194:54239)
0807 05:00:13.368753 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.368797 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.369689 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.370586 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.370595 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.370994 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.371781 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.371802 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.372913 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.372917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.374058 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.374069 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.374639 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.374643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.374818 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.375363 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.375384 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.377072 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.378708 (+ 1636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.378714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.378727 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.379028 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.379294 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.379297 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.379299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.379425 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.379802 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.379808 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.380031 (+ 223us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.380214 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.380508 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":132,"threads_started":1}
I20260807 05:00:13.382381 6553 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42263
I20260807 05:00:13.382517 6553 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:13.382988 6553 heartbeater.cc:511] Master 127.25.214.254:42263 requested a full tablet report, sending...
I20260807 05:00:13.383455 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 6346
I20260807 05:00:13.383596 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:13.383885 26459 external_mini_cluster.cc:1428] Setting key 39458a891a942cc630d12ddd5c641796
I20260807 05:00:13.384771 6006 ts_manager.cc:194] Registered new tserver with Master: c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493)
I20260807 05:00:13.385334 6006 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:54239
I20260807 05:00:13.391111 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.384369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:59865 (local address 127.25.214.254:42263)
0807 05:00:13.384490 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.384495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.384682 (+ 187us) server_negotiation.cc:407] Connection header received
0807 05:00:13.384798 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.384801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.384840 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.384911 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.385463 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.386123 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.387143 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.387344 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.387430 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.388433 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.388437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.388440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.388463 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.389673 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.390038 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.390041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.390043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.390111 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.390351 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.390354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.390356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.390557 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.390640 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.390874 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.390969 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:00:13.391129 6565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.384293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.25.214.194:59865)
0807 05:00:13.384610 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.384623 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.384712 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.385024 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.385027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.385219 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.385338 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.385346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.386279 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.386282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.387004 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.387027 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.387448 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.387452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.387540 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.387956 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.387969 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.388309 (+ 340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.389770 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.389773 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.389775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.389953 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.390192 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.390195 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.390197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.390273 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.390645 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.390648 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.390731 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.390814 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.390936 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for oryx/127.25.214.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab.
Entry for principal oryx/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab.
I20260807 05:00:13.410785 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42263
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:13.520979 6568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:13.521198 6568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:13.521237 6568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:13.525075 6568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:13.525116 6568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:13.525151 6568 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 05:00:13.525179 6568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:13.530099 6568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.214.254:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:13.530931 6568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:13.531795 6568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:13.540622 6576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:13.540688 6575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:13.540656 6568 server_base.cc:1034] running on GCE node
W20260807 05:00:13.540630 6580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:13.541200 6568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:13.541846 6568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:13.543077 6568 hybrid_clock.cc:648] HybridClock initialized: now 1786078813543062 us; error 24 us; skew 500 ppm
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:13.545609 6568 init.cc:377] Logged in from keytab as oryx/127.25.214.195@KRBTEST.COM (short username oryx)
I20260807 05:00:13.546388 6568 webserver.cc:460] Webserver started at http://127.25.214.195:37987/ using document root <none> and password file <none>
I20260807 05:00:13.546942 6568 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:13.547000 6568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:13.547191 6568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:13.549152 6568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "3be4b705ea83f8c1fd05c628d12bf199"
server_key_iv: "41d80a1a76c7d1a3d54bcacc5ee9a234"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.549679 6568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "3be4b705ea83f8c1fd05c628d12bf199"
server_key_iv: "41d80a1a76c7d1a3d54bcacc5ee9a234"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.553157 6568 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 05:00:13.555570 6594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:13.556833 6568 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:13.556964 6568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
format_stamp: "Formatted at 2026-08-07 05:00:13 on dist-test-slave-lgr5"
server_key: "3be4b705ea83f8c1fd05c628d12bf199"
server_key_iv: "41d80a1a76c7d1a3d54bcacc5ee9a234"
server_key_version: "encryptionkey@0"
I20260807 05:00:13.557073 6568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:13.568267 6568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:13.571142 6568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:13.571316 6568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:13.572830 6568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:13.572880 6568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:13.572921 6568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:13.572945 6568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:13.584228 6568 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:41953
I20260807 05:00:13.584263 6780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:41953 every 8 connection(s)
I20260807 05:00:13.585255 6568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:13.586674 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.573512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:39075 (local address 127.25.214.254:42263)
0807 05:00:13.573657 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.573661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.574570 (+ 909us) server_negotiation.cc:407] Connection header received
0807 05:00:13.575506 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.575509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.575570 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.575648 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.577022 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.577745 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.579499 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.579849 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.579955 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.583106 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.583109 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.583112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.583137 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.584655 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.585202 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.585205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.585207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.585282 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.585613 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.585616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.585618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.585863 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.585961 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.586441 (+ 480us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.586543 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 05:00:13.587482 6616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.573953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.25.214.195:39075)
0807 05:00:13.574418 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.574461 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.575294 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.575832 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.575840 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.576221 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.576860 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.576882 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.577893 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.577898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.579340 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.579354 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.580021 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.580027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.580275 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.580924 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.580946 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.582931 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.584758 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.584764 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.584777 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.585106 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.585381 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.585385 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.585387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.585520 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.585973 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.585979 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.586206 (+ 227us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.586372 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.586683 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":116,"threads_started":1}
I20260807 05:00:13.587486 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 6568
I20260807 05:00:13.587596 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:13.587863 26459 external_mini_cluster.cc:1428] Setting key 11ce9d2fc0a9d2ebd72fec02fb01dbb3
I20260807 05:00:13.588804 6781 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42263
I20260807 05:00:13.588946 6781 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:13.589519 6781 heartbeater.cc:511] Master 127.25.214.254:42263 requested a full tablet report, sending...
I20260807 05:00:13.590590 6006 ts_manager.cc:194] Registered new tserver with Master: 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:13.591305 6006 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:39075
I20260807 05:00:13.591463 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:00:13.598315 6792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.590908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.25.214.195:54359)
0807 05:00:13.591754 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.591768 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.591869 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.592126 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.592129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.592328 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.592459 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.592466 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.593377 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.593380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.594022 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.594032 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.594445 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.594448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.594533 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.595012 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.595026 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.595403 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.596933 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.596936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.596939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.597182 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.597432 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.597434 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.597436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.597525 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.597846 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.597849 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.597948 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.598050 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.598172 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"thread_start_us":93,"threads_started":1}
I20260807 05:00:13.598392 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.590985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:54359 (local address 127.25.214.254:42263)
0807 05:00:13.591600 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.591604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.591840 (+ 236us) server_negotiation.cc:407] Connection header received
0807 05:00:13.591947 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.591950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.591999 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.592073 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.592580 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.593246 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.594136 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.594346 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.594426 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.595520 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.595523 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.595525 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.595547 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.596823 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.597271 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.597274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.597275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.597345 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.597599 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.597601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.597602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.597755 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.597825 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.598126 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.598239 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547}
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 05:00:13.618484 6079 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:13.611912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51490 (local address 127.25.214.254:42263)
0807 05:00:13.612048 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.612052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.612065 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:13.612140 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.612144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.612197 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.612280 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.613084 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.613637 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.614533 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.614761 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.614892 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.618308 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51490: BlockingRecv error: recv got EOF from 127.0.0.1:51490 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078813, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:13.627653 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.620055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.25.214.254:42263)
0807 05:00:13.620219 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.620224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.620333 (+ 109us) server_negotiation.cc:407] Connection header received
0807 05:00:13.620471 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.620475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.620529 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.620594 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.621235 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.621773 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.622514 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.622720 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.622792 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.624901 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.624904 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.624906 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.624930 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.626169 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.626582 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.626585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.626587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.626671 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.626898 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.626900 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.626902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.627089 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.627196 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.627386 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.627488 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 05:00:13.630645 6006 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:13.633761 6006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:13.647521 6813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.641831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41953 (local address 127.0.0.1:47674)
0807 05:00:13.642573 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.642624 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.642757 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.643519 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.643522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.643541 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.643634 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.643639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.644799 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.644803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.645974 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.645986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.646999 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.647003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.647111 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.647149 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.647252 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.647372 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":21,"thread_start_us":56,"threads_started":1}
I20260807 05:00:13.647533 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.642031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47674 (local address 127.25.214.195:41953)
0807 05:00:13.643070 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.643083 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.643104 (+ 21us) server_negotiation.cc:407] Connection header received
0807 05:00:13.643177 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.643182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.643368 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.643750 (+ 382us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.643852 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.644692 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.646112 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.646889 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.647016 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.647154 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.647289 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.647390 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":132,"threads_started":1}
I20260807 05:00:13.647919 6817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.641925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36493 (local address 127.0.0.1:58038)
0807 05:00:13.642845 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.642858 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.642947 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.643430 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.643437 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.643461 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.643599 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.643606 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.645347 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.645351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.646554 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.646565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.647554 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.647558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.647648 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.647675 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.647725 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.647787 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":33,"thread_start_us":118,"threads_started":1}
I20260807 05:00:13.648504 6814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.642255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42085 (local address 127.0.0.1:42858)
0807 05:00:13.643110 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.643121 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.643190 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.643889 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.643892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.643911 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.644006 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.644011 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.645380 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.645383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.646430 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.646449 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.647933 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.647949 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.648046 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.648070 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.648308 (+ 238us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.648378 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":22,"thread_start_us":83,"threads_started":1}
I20260807 05:00:13.648648 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.642557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.25.214.194:36493)
0807 05:00:13.642934 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.642945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.642968 (+ 23us) server_negotiation.cc:407] Connection header received
0807 05:00:13.643057 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.643062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.643269 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.643749 (+ 480us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.643878 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.645215 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.646681 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.647418 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.648251 (+ 833us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.648372 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.648420 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.648515 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":101,"threads_started":1}
I20260807 05:00:13.648955 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.642586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42858 (local address 127.25.214.193:42085)
0807 05:00:13.643410 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.643424 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.643444 (+ 20us) server_negotiation.cc:407] Connection header received
0807 05:00:13.643512 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.643571 (+ 59us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.643747 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.643884 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.644192 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.645291 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.646571 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.647372 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.647522 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.648211 (+ 689us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.648359 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.648456 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":91,"threads_started":1}
I20260807 05:00:13.650718 6684 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5d04f8280e4d2f98f14f159e81854c (DEFAULT_TABLE table=test-table [id=8115f0aa09e547669d4bf21780ac94b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:13.651345 6219 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5d04f8280e4d2f98f14f159e81854c (DEFAULT_TABLE table=test-table [id=8115f0aa09e547669d4bf21780ac94b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:13.651270 6442 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5d04f8280e4d2f98f14f159e81854c (DEFAULT_TABLE table=test-table [id=8115f0aa09e547669d4bf21780ac94b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:13.651898 6684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5d04f8280e4d2f98f14f159e81854c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.652254 6442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5d04f8280e4d2f98f14f159e81854c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.652271 6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5d04f8280e4d2f98f14f159e81854c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.658752 6823 tablet_bootstrap.cc:492] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Bootstrap starting.
I20260807 05:00:13.659502 6824 tablet_bootstrap.cc:492] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Bootstrap starting.
I20260807 05:00:13.660295 6825 tablet_bootstrap.cc:492] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Bootstrap starting.
I20260807 05:00:13.661613 6823 tablet_bootstrap.cc:654] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.661613 6824 tablet_bootstrap.cc:654] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.662147 6825 tablet_bootstrap.cc:654] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.662487 6823 log.cc:824] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:13.662487 6824 log.cc:824] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:13.662803 6825 log.cc:824] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:13.664552 6823 tablet_bootstrap.cc:492] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: No bootstrap required, opened a new log
I20260807 05:00:13.664552 6824 tablet_bootstrap.cc:492] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: No bootstrap required, opened a new log
I20260807 05:00:13.664744 6823 ts_tablet_manager.cc:1397] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:00:13.664745 6824 ts_tablet_manager.cc:1397] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 05:00:13.665352 6825 tablet_bootstrap.cc:492] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: No bootstrap required, opened a new log
I20260807 05:00:13.665524 6825 ts_tablet_manager.cc:1397] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:00:13.668313 6825 raft_consensus.cc:348] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.668524 6825 raft_consensus.cc:374] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.668586 6825 raft_consensus.cc:729] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71a4bba66b44bfab29663ff20bb96f8, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.668445 6823 raft_consensus.cc:348] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.668455 6824 raft_consensus.cc:348] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.668690 6824 raft_consensus.cc:374] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.668690 6823 raft_consensus.cc:374] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.668748 6823 raft_consensus.cc:729] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.668748 6824 raft_consensus.cc:729] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.669044 6825 consensus_queue.cc:260] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.669158 6824 consensus_queue.cc:260] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.669158 6823 consensus_queue.cc:260] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.669768 6335 heartbeater.cc:503] Master 127.25.214.254:42263 was elected leader, sending a full tablet report...
I20260807 05:00:13.669993 6825 ts_tablet_manager.cc:1428] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 05:00:13.670058 6823 ts_tablet_manager.cc:1428] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:00:13.670058 6824 ts_tablet_manager.cc:1428] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:00:13.670295 6553 heartbeater.cc:503] Master 127.25.214.254:42263 was elected leader, sending a full tablet report...
I20260807 05:00:13.670336 6781 heartbeater.cc:503] Master 127.25.214.254:42263 was elected leader, sending a full tablet report...
I20260807 05:00:13.743247 6829 raft_consensus.cc:482] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:13.743495 6829 raft_consensus.cc:504] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.744668 6829 leader_election.cc:288] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953), 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085)
I20260807 05:00:13.748528 6385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.744926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41953 (local address 127.25.214.194:46537)
0807 05:00:13.745078 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.745096 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.745203 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.745537 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.745539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.745553 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.745673 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.745679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.746440 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.746442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.747506 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.747518 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.748196 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.748199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.748281 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.748303 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.748358 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.748413 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 05:00:13.748579 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.745048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:46537 (local address 127.25.214.195:41953)
0807 05:00:13.745168 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.745172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.745188 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:00:13.745387 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.745390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.745434 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.745504 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.745771 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.746331 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.747627 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.748059 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.748191 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.748246 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.748383 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.748451 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:00:13.749147 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.744925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42085 (local address 127.25.214.194:53181)
0807 05:00:13.745444 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.745457 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.745548 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.745762 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.745765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.745782 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.745875 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.745879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.746958 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.746962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.747909 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.747918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.748804 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.748808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.748902 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.748926 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.748989 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.749038 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":173,"thread_start_us":125,"threads_started":1}
I20260807 05:00:13.749221 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.745026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:53181 (local address 127.25.214.193:42085)
0807 05:00:13.745171 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.745176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.745536 (+ 360us) server_negotiation.cc:407] Connection header received
0807 05:00:13.745639 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.745642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.745680 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.745742 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.746301 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.746850 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.748031 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.748570 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.748679 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.748726 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.749035 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.749109 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 05:00:13.749199 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5d04f8280e4d2f98f14f159e81854c" candidate_uuid: "c71a4bba66b44bfab29663ff20bb96f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" is_pre_election: true
I20260807 05:00:13.749526 6710 raft_consensus.cc:2454] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c71a4bba66b44bfab29663ff20bb96f8 in term 0.
I20260807 05:00:13.749753 6256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5d04f8280e4d2f98f14f159e81854c" candidate_uuid: "c71a4bba66b44bfab29663ff20bb96f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a8a44f333a44b198319c45f06abb0c" is_pre_election: true
I20260807 05:00:13.750025 6256 raft_consensus.cc:2454] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c71a4bba66b44bfab29663ff20bb96f8 in term 0.
I20260807 05:00:13.750022 6370 leader_election.cc:302] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, c71a4bba66b44bfab29663ff20bb96f8; no voters:
I20260807 05:00:13.750272 6829 raft_consensus.cc:2781] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:13.750350 6829 raft_consensus.cc:482] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:13.750398 6829 raft_consensus.cc:3037] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:13.751434 6829 raft_consensus.cc:504] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.751771 6829 leader_election.cc:288] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [CANDIDATE]: Term 1 election: Requested vote from peers 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953), 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085)
I20260807 05:00:13.752104 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5d04f8280e4d2f98f14f159e81854c" candidate_uuid: "c71a4bba66b44bfab29663ff20bb96f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
I20260807 05:00:13.752151 6256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5d04f8280e4d2f98f14f159e81854c" candidate_uuid: "c71a4bba66b44bfab29663ff20bb96f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a8a44f333a44b198319c45f06abb0c"
I20260807 05:00:13.752223 6710 raft_consensus.cc:3037] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:13.752260 6256 raft_consensus.cc:3037] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:13.753221 6710 raft_consensus.cc:2454] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c71a4bba66b44bfab29663ff20bb96f8 in term 1.
I20260807 05:00:13.753305 6256 raft_consensus.cc:2454] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c71a4bba66b44bfab29663ff20bb96f8 in term 1.
I20260807 05:00:13.753502 6370 leader_election.cc:302] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, c71a4bba66b44bfab29663ff20bb96f8; no voters:
I20260807 05:00:13.753688 6829 raft_consensus.cc:2781] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:13.753933 6829 raft_consensus.cc:686] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 LEADER]: Becoming Leader. State: Replica: c71a4bba66b44bfab29663ff20bb96f8, State: Running, Role: LEADER
I20260807 05:00:13.754267 6829 consensus_queue.cc:237] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } }
I20260807 05:00:13.757545 6004 catalog_manager.cc:5495] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194). New cstate: current_term: 1 leader_uuid: "c71a4bba66b44bfab29663ff20bb96f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:13.768023 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.764685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.25.214.194:36493)
0807 05:00:13.764797 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.764802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.764814 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:00:13.764943 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.764946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.764996 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.765083 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:13.765332 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.765837 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.766659 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.766876 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.766962 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.767239 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:13.767657 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:13.767759 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.767837 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.767888 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:00:13.773379 6256 raft_consensus.cc:1261] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Refusing update from remote peer c71a4bba66b44bfab29663ff20bb96f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:13.773379 6710 raft_consensus.cc:1261] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Refusing update from remote peer c71a4bba66b44bfab29663ff20bb96f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:13.774026 6836 consensus_queue.cc:1035] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:13.774197 6829 consensus_queue.cc:1035] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:13.781293 6840 mvcc.cc:205] Tried to move back new op lower bound from 7315778821209153536 to 7315778821140058112. Current Snapshot: MvccSnapshot[applied={T|T < 7315778821209153536}]
I20260807 05:00:13.782372 6842 mvcc.cc:205] Tried to move back new op lower bound from 7315778821209153536 to 7315778821140058112. Current Snapshot: MvccSnapshot[applied={T|T < 7315778821209153536}]
I20260807 05:00:13.784919 6841 mvcc.cc:205] Tried to move back new op lower bound from 7315778821209153536 to 7315778821140058112. Current Snapshot: MvccSnapshot[applied={T|T < 7315778821209153536}]
I20260807 05:00:13.790874 6005 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:13.791059 6005 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:13.793488 6005 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Sending DeleteTablet for 3 replicas of tablet 9f5d04f8280e4d2f98f14f159e81854c
I20260807 05:00:13.794229 6684 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5d04f8280e4d2f98f14f159e81854c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:13 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:47674
I20260807 05:00:13.794265 6442 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5d04f8280e4d2f98f14f159e81854c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:13 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:58038
I20260807 05:00:13.794713 6852 tablet_replica.cc:330] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: stopping tablet replica
I20260807 05:00:13.794744 6853 tablet_replica.cc:330] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: stopping tablet replica
I20260807 05:00:13.795051 6853 raft_consensus.cc:2229] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:13.795073 6852 raft_consensus.cc:2229] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:13.795229 6219 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5d04f8280e4d2f98f14f159e81854c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:13 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42858
I20260807 05:00:13.795498 6853 raft_consensus.cc:2258] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:13.795614 6852 raft_consensus.cc:2258] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:13.796211 6855 tablet_replica.cc:330] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: stopping tablet replica
I20260807 05:00:13.796484 6855 raft_consensus.cc:2229] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:13.796432 6005 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 05:00:13.796764 6855 raft_consensus.cc:2258] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 05:00:13.796869 6005 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:13.797565 6852 ts_tablet_manager.cc:1905] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:13.798717 6853 ts_tablet_manager.cc:1905] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:13.800619 6852 ts_tablet_manager.cc:1918] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:13.800777 6852 log.cc:1196] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/9f5d04f8280e4d2f98f14f159e81854c
I20260807 05:00:13.801232 6852 ts_tablet_manager.cc:1939] T 9f5d04f8280e4d2f98f14f159e81854c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting consensus metadata
I20260807 05:00:13.801510 6853 ts_tablet_manager.cc:1918] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:13.801611 6853 log.cc:1196] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/9f5d04f8280e4d2f98f14f159e81854c
I20260807 05:00:13.801909 6853 ts_tablet_manager.cc:1939] T 9f5d04f8280e4d2f98f14f159e81854c P c71a4bba66b44bfab29663ff20bb96f8: Deleting consensus metadata
I20260807 05:00:13.802772 6442 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6155789d14b9393cbc06c3cbd1a40 (DEFAULT_TABLE table=test-table [id=6068531581a94d598f96ba1b9fb9711a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:13.802817 5980 catalog_manager.cc:4841] TS 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953): tablet 9f5d04f8280e4d2f98f14f159e81854c (table test-table [id=8115f0aa09e547669d4bf21780ac94b3]) successfully deleted
I20260807 05:00:13.802968 6684 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6155789d14b9393cbc06c3cbd1a40 (DEFAULT_TABLE table=test-table [id=6068531581a94d598f96ba1b9fb9711a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:13.803035 6442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6155789d14b9393cbc06c3cbd1a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.803206 6684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6155789d14b9393cbc06c3cbd1a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.803442 6219 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6155789d14b9393cbc06c3cbd1a40 (DEFAULT_TABLE table=test-table [id=6068531581a94d598f96ba1b9fb9711a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:13.803692 6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6155789d14b9393cbc06c3cbd1a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.805187 6825 tablet_bootstrap.cc:492] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Bootstrap starting.
I20260807 05:00:13.805573 6824 tablet_bootstrap.cc:492] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Bootstrap starting.
I20260807 05:00:13.805999 5982 catalog_manager.cc:4841] TS c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493): tablet 9f5d04f8280e4d2f98f14f159e81854c (table test-table [id=8115f0aa09e547669d4bf21780ac94b3]) successfully deleted
I20260807 05:00:13.806228 6825 tablet_bootstrap.cc:654] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.806258 6823 tablet_bootstrap.cc:492] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Bootstrap starting.
I20260807 05:00:13.806489 6824 tablet_bootstrap.cc:654] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.807217 6823 tablet_bootstrap.cc:654] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.807629 6855 ts_tablet_manager.cc:1905] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:13.808238 6824 tablet_bootstrap.cc:492] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: No bootstrap required, opened a new log
I20260807 05:00:13.808323 6824 ts_tablet_manager.cc:1397] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:13.808815 6823 tablet_bootstrap.cc:492] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: No bootstrap required, opened a new log
I20260807 05:00:13.808809 6824 raft_consensus.cc:348] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.808887 6823 ts_tablet_manager.cc:1397] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:13.808923 6824 raft_consensus.cc:374] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.808959 6824 raft_consensus.cc:729] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.809087 6824 consensus_queue.cc:260] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.809341 6824 ts_tablet_manager.cc:1428] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:13.809327 6823 raft_consensus.cc:348] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.809429 6823 raft_consensus.cc:374] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.809471 6823 raft_consensus.cc:729] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.809584 6823 consensus_queue.cc:260] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.809834 6823 ts_tablet_manager.cc:1428] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:13.812222 6855 ts_tablet_manager.cc:1918] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:13.812312 6855 log.cc:1196] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/9f5d04f8280e4d2f98f14f159e81854c
I20260807 05:00:13.812570 6855 ts_tablet_manager.cc:1939] T 9f5d04f8280e4d2f98f14f159e81854c P 08a8a44f333a44b198319c45f06abb0c: Deleting consensus metadata
I20260807 05:00:13.813634 5985 catalog_manager.cc:4841] TS 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085): tablet 9f5d04f8280e4d2f98f14f159e81854c (table test-table [id=8115f0aa09e547669d4bf21780ac94b3]) successfully deleted
I20260807 05:00:13.814289 6825 tablet_bootstrap.cc:492] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: No bootstrap required, opened a new log
I20260807 05:00:13.814389 6825 ts_tablet_manager.cc:1397] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 05:00:13.814831 6825 raft_consensus.cc:348] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.814929 6825 raft_consensus.cc:374] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.814949 6825 raft_consensus.cc:729] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71a4bba66b44bfab29663ff20bb96f8, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.815078 6825 consensus_queue.cc:260] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.815316 6825 ts_tablet_manager.cc:1428] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260807 05:00:13.836269 6784 tablet.cc:2369] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:00:13.836283 6830 raft_consensus.cc:482] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:13.836402 6830 raft_consensus.cc:504] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.837625 6830 leader_election.cc:288] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493), 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:13.842166 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.838086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:34035 (local address 127.25.214.195:41953)
0807 05:00:13.838234 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.838239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.838260 (+ 21us) server_negotiation.cc:407] Connection header received
0807 05:00:13.838446 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.838450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.838501 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.838562 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.838996 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.839569 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.840963 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.841587 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.841709 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.841765 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.841964 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.842040 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:00:13.842181 6860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.837815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41953 (local address 127.25.214.193:34035)
0807 05:00:13.838187 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.838201 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.838310 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.838702 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.838704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.838718 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.838849 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.838857 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.839683 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.839685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.840831 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.840842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.841733 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.841737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.841838 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.841858 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.841929 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.842007 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":95,"threads_started":1}
I20260807 05:00:13.842320 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.838217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:37115 (local address 127.25.214.194:36493)
0807 05:00:13.838323 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.838327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.838532 (+ 205us) server_negotiation.cc:407] Connection header received
0807 05:00:13.838704 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.838707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.838748 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.838790 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:13.839196 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.839963 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.841224 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.841627 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.841734 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.841788 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.842116 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.842193 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:00:13.842708 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.837815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36493 (local address 127.25.214.193:37115)
0807 05:00:13.838463 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.838474 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.838593 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.838908 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.838911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.838927 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:13.839045 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.839052 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.840113 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.840116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.841114 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.841122 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.841853 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.841857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.841966 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.841991 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.842472 (+ 481us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.842551 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":57,"thread_start_us":104,"threads_started":1}
I20260807 05:00:13.842733 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6155789d14b9393cbc06c3cbd1a40" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" is_pre_election: true
I20260807 05:00:13.842895 6710 raft_consensus.cc:2454] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 0.
I20260807 05:00:13.843335 6138 leader_election.cc:302] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7; no voters:
I20260807 05:00:13.843418 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6155789d14b9393cbc06c3cbd1a40" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8" is_pre_election: true
I20260807 05:00:13.843672 6830 raft_consensus.cc:2781] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:13.843667 6465 raft_consensus.cc:2454] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 0.
I20260807 05:00:13.843743 6830 raft_consensus.cc:482] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:13.843780 6830 raft_consensus.cc:3037] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:13.844892 6830 raft_consensus.cc:504] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.845256 6830 leader_election.cc:288] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 election: Requested vote from peers c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493), 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:13.845593 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6155789d14b9393cbc06c3cbd1a40" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8"
I20260807 05:00:13.845606 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6155789d14b9393cbc06c3cbd1a40" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
I20260807 05:00:13.845718 6465 raft_consensus.cc:3037] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:13.845719 6710 raft_consensus.cc:3037] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:13.846596 6710 raft_consensus.cc:2454] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 1.
I20260807 05:00:13.846917 6138 leader_election.cc:302] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7; no voters:
I20260807 05:00:13.846935 6465 raft_consensus.cc:2454] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 1.
I20260807 05:00:13.847088 6830 raft_consensus.cc:2781] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:13.847313 6830 raft_consensus.cc:686] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 1 LEADER]: Becoming Leader. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Running, Role: LEADER
I20260807 05:00:13.847568 6830 consensus_queue.cc:237] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.849960 6004 catalog_manager.cc:5495] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08a8a44f333a44b198319c45f06abb0c (127.25.214.193). New cstate: current_term: 1 leader_uuid: "08a8a44f333a44b198319c45f06abb0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } health_report { overall_health: UNKNOWN } } }
W20260807 05:00:13.879323 6554 tablet.cc:2369] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 05:00:13 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078812, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.254@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:13.898910 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.889934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42263 (local address 127.0.0.1:51506)
0807 05:00:13.890222 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:13.890234 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:13.890359 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:13.890592 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:13.890595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:13.890963 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:13.891061 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.891068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.891801 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.891805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.892464 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:13.892477 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.893095 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.893098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:13.893173 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.893823 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:13.893837 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:13.895567 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:13.897452 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.897461 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.897466 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.897688 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.897970 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:13.897971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:13.897973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:13.898042 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:13.898449 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:13.898453 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:13.898554 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 05:00:13.898639 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:00:13.898757 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":121,"threads_started":1}
I20260807 05:00:13.899024 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:13.889968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.25.214.254:42263)
0807 05:00:13.890091 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:13.890096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:13.890311 (+ 215us) server_negotiation.cc:407] Connection header received
0807 05:00:13.890455 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:13.890458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:13.890497 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:13.890556 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:13.891172 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.891706 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.892617 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:13.892969 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:13.893078 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:13.895716 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:13.895720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:13.895724 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:13.895750 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:13.897329 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.897790 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.897794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.897796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.897887 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:13.898121 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:13.898124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:13.898126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:13.898357 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:13.898470 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:13.898721 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 05:00:13.898848 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 05:00:13.901666 6336 tablet.cc:2369] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:00:13.903569 6004 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:51506:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 05:00:13.904479 6004 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:13.909584 6219 tablet_service.cc:1467] Processing CreateTablet for tablet 945498b7af97434ab8d17e15370bc3fe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6805af61e62c49209733ed5cbe62ea05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 05:00:13.909698 6684 tablet_service.cc:1467] Processing CreateTablet for tablet 945498b7af97434ab8d17e15370bc3fe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6805af61e62c49209733ed5cbe62ea05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 05:00:13.909868 6442 tablet_service.cc:1467] Processing CreateTablet for tablet 945498b7af97434ab8d17e15370bc3fe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6805af61e62c49209733ed5cbe62ea05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 05:00:13.910053 6684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945498b7af97434ab8d17e15370bc3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.910055 6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945498b7af97434ab8d17e15370bc3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.910276 6442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945498b7af97434ab8d17e15370bc3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:13.913259 6823 tablet_bootstrap.cc:492] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: Bootstrap starting.
I20260807 05:00:13.913482 6825 tablet_bootstrap.cc:492] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: Bootstrap starting.
I20260807 05:00:13.914355 6825 tablet_bootstrap.cc:654] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.914352 6823 tablet_bootstrap.cc:654] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.915097 6824 tablet_bootstrap.cc:492] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Bootstrap starting.
I20260807 05:00:13.916059 6823 tablet_bootstrap.cc:492] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: No bootstrap required, opened a new log
I20260807 05:00:13.916173 6823 ts_tablet_manager.cc:1397] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:13.916306 6824 tablet_bootstrap.cc:654] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:13.916651 6823 raft_consensus.cc:348] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.916769 6823 raft_consensus.cc:374] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.916803 6823 raft_consensus.cc:729] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.916939 6823 consensus_queue.cc:260] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.917202 6862 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:13.917363 6862 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:13.917204 6823 ts_tablet_manager.cc:1428] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 05:00:13.918098 6825 tablet_bootstrap.cc:492] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: No bootstrap required, opened a new log
I20260807 05:00:13.918190 6825 ts_tablet_manager.cc:1397] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 05:00:13.918453 6824 tablet_bootstrap.cc:492] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: No bootstrap required, opened a new log
I20260807 05:00:13.918526 6824 ts_tablet_manager.cc:1397] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:13.918674 6825 raft_consensus.cc:348] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.918792 6825 raft_consensus.cc:374] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.918824 6825 raft_consensus.cc:729] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71a4bba66b44bfab29663ff20bb96f8, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.918917 6824 raft_consensus.cc:348] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.918959 6825 consensus_queue.cc:260] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.919026 6824 raft_consensus.cc:374] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:13.919050 6824 raft_consensus.cc:729] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, State: Initialized, Role: FOLLOWER
I20260807 05:00:13.919157 6824 consensus_queue.cc:260] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:13.919217 6836 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:13.919340 6836 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:13.919417 6824 ts_tablet_manager.cc:1428] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:13.919996 6831 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:13.920190 6831 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:13.922700 6825 ts_tablet_manager.cc:1428] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260807 05:00:14.152307 6831 raft_consensus.cc:482] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:14.152488 6831 raft_consensus.cc:504] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.153641 6831 leader_election.cc:288] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085), c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493)
I20260807 05:00:14.158610 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.154322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:53153 (local address 127.25.214.194:36493)
0807 05:00:14.154444 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.154448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.154461 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:14.154601 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.154605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.154652 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.154723 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:14.154974 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.155740 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.157583 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.157983 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.158069 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.158113 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.158392 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.158472 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 05:00:14.158757 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.154068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:56123 (local address 127.25.214.193:42085)
0807 05:00:14.154180 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.154185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.154255 (+ 70us) server_negotiation.cc:407] Connection header received
0807 05:00:14.154420 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.154424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.154469 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.154516 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:14.154910 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.155751 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.157576 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.158242 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.158360 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.158405 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.158565 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.158633 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:00:14.158993 6878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.153917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36493 (local address 127.25.214.195:53153)
0807 05:00:14.154394 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:14.154406 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:14.154488 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:14.154737 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:14.154739 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:14.154754 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:14.154867 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.154872 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.155873 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.155876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.157435 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.157446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.158193 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.158196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.158271 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.158288 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 05:00:14.158774 (+ 486us) client_negotiation.cc:240] Negotiation successful
0807 05:00:14.158845 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":197,"thread_start_us":85,"threads_started":1}
I20260807 05:00:14.159121 6876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.153831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42085 (local address 127.25.214.195:56123)
0807 05:00:14.154170 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:14.154185 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:14.154291 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:14.154661 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:14.154664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:14.154681 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:14.154803 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.154810 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.155873 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.155876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.157434 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.157446 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.158363 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.158367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.158454 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.158473 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 05:00:14.158551 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 05:00:14.158622 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":116,"thread_start_us":74,"threads_started":1}
I20260807 05:00:14.159550 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945498b7af97434ab8d17e15370bc3fe" candidate_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8" is_pre_election: true
I20260807 05:00:14.159562 6256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945498b7af97434ab8d17e15370bc3fe" candidate_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a8a44f333a44b198319c45f06abb0c" is_pre_election: true
I20260807 05:00:14.159724 6465 raft_consensus.cc:2454] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24ae0c6c6edb4b79ab6ced4cc1d62bf7 in term 0.
I20260807 05:00:14.159726 6256 raft_consensus.cc:2454] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24ae0c6c6edb4b79ab6ced4cc1d62bf7 in term 0.
I20260807 05:00:14.160202 6608 leader_election.cc:302] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7, c71a4bba66b44bfab29663ff20bb96f8; no voters:
I20260807 05:00:14.160677 6831 raft_consensus.cc:2781] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:14.160738 6831 raft_consensus.cc:482] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:14.160780 6831 raft_consensus.cc:3037] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.161921 6831 raft_consensus.cc:504] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.162283 6831 leader_election.cc:288] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [CANDIDATE]: Term 1 election: Requested vote from peers 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085), c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493)
I20260807 05:00:14.162650 6256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945498b7af97434ab8d17e15370bc3fe" candidate_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a8a44f333a44b198319c45f06abb0c"
I20260807 05:00:14.162758 6256 raft_consensus.cc:3037] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.163570 6256 raft_consensus.cc:2454] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24ae0c6c6edb4b79ab6ced4cc1d62bf7 in term 1.
I20260807 05:00:14.163805 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945498b7af97434ab8d17e15370bc3fe" candidate_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8"
I20260807 05:00:14.163863 6608 leader_election.cc:302] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7; no voters:
I20260807 05:00:14.163910 6465 raft_consensus.cc:3037] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.164099 6831 raft_consensus.cc:2781] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:14.164288 6831 raft_consensus.cc:686] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 LEADER]: Becoming Leader. State: Replica: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, State: Running, Role: LEADER
I20260807 05:00:14.164553 6831 consensus_queue.cc:237] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.165063 6465 raft_consensus.cc:2454] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24ae0c6c6edb4b79ab6ced4cc1d62bf7 in term 1.
I20260807 05:00:14.165822 6880 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: TxnStatusTablet state changed. Reason: New leader 24ae0c6c6edb4b79ab6ced4cc1d62bf7. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.165930 6880 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: This TxnStatusTablet replica's current role is: LEADER
I20260807 05:00:14.166489 6886 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 05:00:14.166649 6886 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 05:00:14.167070 6004 catalog_manager.cc:5495] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260807 05:00:14.219302 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.215577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41953 (local address 127.0.0.1:47684)
0807 05:00:14.215745 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:14.215763 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:14.215883 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:14.216270 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:14.216273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:14.216280 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 05:00:14.216399 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.216404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.217135 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.217139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.217750 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.217759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.218189 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.218193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.218282 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.218326 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.219009 (+ 683us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.219026 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 05:00:14.219090 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 05:00:14.219174 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 05:00:14.219323 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.215750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.25.214.195:41953)
0807 05:00:14.215881 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.215885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.215909 (+ 24us) server_negotiation.cc:407] Connection header received
0807 05:00:14.216048 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.216051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.216147 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.216241 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:14.216498 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.217028 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.217860 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.218085 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.218172 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.218482 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.218914 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.219017 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.219102 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.219153 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:00:14.222462 6256 raft_consensus.cc:1261] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Refusing update from remote peer 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.222522 6465 raft_consensus.cc:1261] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Refusing update from remote peer 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.223057 6831 consensus_queue.cc:1035] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.223238 6880 consensus_queue.cc:1035] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.224766 6862 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: TxnStatusTablet state changed. Reason: New leader 24ae0c6c6edb4b79ab6ced4cc1d62bf7. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.224893 6862 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:14.225057 6836 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: TxnStatusTablet state changed. Reason: New leader 24ae0c6c6edb4b79ab6ced4cc1d62bf7. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.225174 6836 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:14.227373 6831 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.227489 6831 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: This TxnStatusTablet replica's current role is: LEADER
I20260807 05:00:14.227852 6862 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.227953 6862 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 08a8a44f333a44b198319c45f06abb0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:14.229219 6880 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.229326 6880 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: This TxnStatusTablet replica's current role is: LEADER
I20260807 05:00:14.230580 6836 tablet_replica.cc:439] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } } }
I20260807 05:00:14.230684 6836 tablet_replica.cc:442] T 945498b7af97434ab8d17e15370bc3fe P c71a4bba66b44bfab29663ff20bb96f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 05:00:14.236855 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.233087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42874 (local address 127.25.214.193:42085)
0807 05:00:14.233205 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.233210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.233243 (+ 33us) server_negotiation.cc:407] Connection header received
0807 05:00:14.233366 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.233369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.233432 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.233547 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:14.233691 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.234461 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.235272 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.235624 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.235725 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.235888 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.236483 (+ 595us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.236607 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.236660 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.236718 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:00:14.247282 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.243924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:60159 (local address 127.25.214.195:41953)
0807 05:00:14.244138 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.244142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.244221 (+ 79us) server_negotiation.cc:407] Connection header received
0807 05:00:14.244343 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.244345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.244387 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.244446 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:14.244683 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.245169 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.246358 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.246556 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.246624 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.246911 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.246975 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.247021 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.247127 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.247172 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260807 05:00:14.247354 6897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.243793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41953 (local address 127.25.214.193:60159)
0807 05:00:14.244143 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:14.244158 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:14.244261 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:14.244466 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:14.244469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:14.244476 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 05:00:14.244600 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.244606 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.245254 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.245257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.246260 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.246271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.246643 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.246646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.246739 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.246792 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.247044 (+ 252us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.247050 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:00:14.247109 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 05:00:14.247186 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":124,"threads_started":1}
I20260807 05:00:14.253975 6465 raft_consensus.cc:1261] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Refusing update from remote peer 08a8a44f333a44b198319c45f06abb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.253997 6710 raft_consensus.cc:1261] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Refusing update from remote peer 08a8a44f333a44b198319c45f06abb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.254487 6830 consensus_queue.cc:1035] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.254657 6862 consensus_queue.cc:1035] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.279078 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.274845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:38559 (local address 127.25.214.193:42085)
0807 05:00:14.274971 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.274976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.275093 (+ 117us) server_negotiation.cc:407] Connection header received
0807 05:00:14.275691 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.275695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.275752 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.275832 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:14.276154 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.276870 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.277736 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.278078 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.278182 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.278585 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.278681 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.278758 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.278852 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.278923 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:00:14.279145 6902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.274551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42085 (local address 127.25.214.195:38559)
0807 05:00:14.274859 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:14.275015 (+ 156us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:14.275400 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:14.275857 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:14.275860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:14.275870 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 05:00:14.276015 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.276021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.276989 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.276992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.277609 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:14.277617 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.278278 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.278281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:14.278385 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.278445 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.278770 (+ 325us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.278776 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:00:14.278839 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 05:00:14.278933 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":105,"threads_started":1}
I20260807 05:00:14.308050 6004 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:14.308272 6004 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:14.310775 6004 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Sending DeleteTablet for 3 replicas of tablet 17d6155789d14b9393cbc06c3cbd1a40
I20260807 05:00:14.311419 6219 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6155789d14b9393cbc06c3cbd1a40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42858
I20260807 05:00:14.311618 6855 tablet_replica.cc:330] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: stopping tablet replica
I20260807 05:00:14.311728 6855 raft_consensus.cc:2229] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:14.311800 6684 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6155789d14b9393cbc06c3cbd1a40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:47674
I20260807 05:00:14.312059 6855 raft_consensus.cc:2258] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.312708 6442 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6155789d14b9393cbc06c3cbd1a40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:58038
I20260807 05:00:14.313186 6906 tablet_replica.cc:330] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: stopping tablet replica
I20260807 05:00:14.313349 6906 raft_consensus.cc:2229] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:14.313529 6906 raft_consensus.cc:2258] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.313583 6855 ts_tablet_manager.cc:1905] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.314237 6906 ts_tablet_manager.cc:1905] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.317418 6906 ts_tablet_manager.cc:1918] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 05:00:14.317574 6906 log.cc:1196] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/17d6155789d14b9393cbc06c3cbd1a40
I20260807 05:00:14.317893 6906 ts_tablet_manager.cc:1939] T 17d6155789d14b9393cbc06c3cbd1a40 P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting consensus metadata
I20260807 05:00:14.318727 5980 catalog_manager.cc:4841] TS 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953): tablet 17d6155789d14b9393cbc06c3cbd1a40 (table test-table [id=6068531581a94d598f96ba1b9fb9711a]) successfully deleted
I20260807 05:00:14.321511 6855 ts_tablet_manager.cc:1918] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 05:00:14.321600 6855 log.cc:1196] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/17d6155789d14b9393cbc06c3cbd1a40
I20260807 05:00:14.321859 6855 ts_tablet_manager.cc:1939] T 17d6155789d14b9393cbc06c3cbd1a40 P 08a8a44f333a44b198319c45f06abb0c: Deleting consensus metadata
I20260807 05:00:14.322575 6907 tablet_replica.cc:330] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: stopping tablet replica
I20260807 05:00:14.322638 5985 catalog_manager.cc:4841] TS 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085): tablet 17d6155789d14b9393cbc06c3cbd1a40 (table test-table [id=6068531581a94d598f96ba1b9fb9711a]) successfully deleted
I20260807 05:00:14.322707 6907 raft_consensus.cc:2229] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:14.322818 6907 raft_consensus.cc:2258] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.323484 6907 ts_tablet_manager.cc:1905] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.326500 6907 ts_tablet_manager.cc:1918] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 05:00:14.326588 6907 log.cc:1196] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/17d6155789d14b9393cbc06c3cbd1a40
I20260807 05:00:14.326817 6907 ts_tablet_manager.cc:1939] T 17d6155789d14b9393cbc06c3cbd1a40 P c71a4bba66b44bfab29663ff20bb96f8: Deleting consensus metadata
I20260807 05:00:14.327626 5982 catalog_manager.cc:4841] TS c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493): tablet 17d6155789d14b9393cbc06c3cbd1a40 (table test-table [id=6068531581a94d598f96ba1b9fb9711a]) successfully deleted
Aug 07 05:00:14 dist-test-slave-lgr5 krb5kdc[5930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 05:00:14 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:14 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 05:00:14.352586 6079 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:14.345975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51522 (local address 127.25.214.254:42263)
0807 05:00:14.346151 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.346155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.346330 (+ 175us) server_negotiation.cc:407] Connection header received
0807 05:00:14.346484 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.346488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.346538 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.346608 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:14.347325 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.347884 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.348865 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.349097 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.349191 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.352440 (+ 3249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51522: BlockingRecv error: recv got EOF from 127.0.0.1:51522 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 07 05:00:14 dist-test-slave-lgr5 krb5kdc[5930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM
I20260807 05:00:14.362587 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.354134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51534 (local address 127.25.214.254:42263)
0807 05:00:14.354246 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.354250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.354375 (+ 125us) server_negotiation.cc:407] Connection header received
0807 05:00:14.354523 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.354527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.354569 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.354649 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:14.355228 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.355745 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.356546 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.356760 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.356847 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.359354 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:14.359357 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:14.359359 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:14.359384 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:14.360960 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:14.361443 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:14.361446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:14.361448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:14.361544 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:14.361819 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:14.361822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:14.361824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:14.362008 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:14.362106 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.362338 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.362433 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 05:00:14.365346 6004 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:14.365850 6004 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:14.371241 6219 tablet_service.cc:1467] Processing CreateTablet for tablet 4409f4736b204cd48c521058a705032c (DEFAULT_TABLE table=test-table [id=e96ac76c29c04e70b234820057c03c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:14.371591 6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4409f4736b204cd48c521058a705032c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:14.373786 6823 tablet_bootstrap.cc:492] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Bootstrap starting.
I20260807 05:00:14.374107 6442 tablet_service.cc:1467] Processing CreateTablet for tablet 4409f4736b204cd48c521058a705032c (DEFAULT_TABLE table=test-table [id=e96ac76c29c04e70b234820057c03c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:14.374416 6442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4409f4736b204cd48c521058a705032c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:14.374800 6823 tablet_bootstrap.cc:654] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:14.376252 6684 tablet_service.cc:1467] Processing CreateTablet for tablet 4409f4736b204cd48c521058a705032c (DEFAULT_TABLE table=test-table [id=e96ac76c29c04e70b234820057c03c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:14.376561 6684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4409f4736b204cd48c521058a705032c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:14.376894 6825 tablet_bootstrap.cc:492] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Bootstrap starting.
I20260807 05:00:14.376928 6823 tablet_bootstrap.cc:492] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: No bootstrap required, opened a new log
I20260807 05:00:14.377041 6823 ts_tablet_manager.cc:1397] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 05:00:14.377511 6823 raft_consensus.cc:348] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.377636 6823 raft_consensus.cc:374] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:14.377667 6823 raft_consensus.cc:729] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Initialized, Role: FOLLOWER
I20260807 05:00:14.377737 6825 tablet_bootstrap.cc:654] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:14.377790 6823 consensus_queue.cc:260] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.378042 6823 ts_tablet_manager.cc:1428] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 05:00:14.379400 6824 tablet_bootstrap.cc:492] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Bootstrap starting.
I20260807 05:00:14.380352 6824 tablet_bootstrap.cc:654] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:14.383196 6824 tablet_bootstrap.cc:492] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: No bootstrap required, opened a new log
I20260807 05:00:14.383318 6824 ts_tablet_manager.cc:1397] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 05:00:14.383841 6824 raft_consensus.cc:348] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.383976 6824 raft_consensus.cc:374] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:14.384008 6824 raft_consensus.cc:729] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, State: Initialized, Role: FOLLOWER
I20260807 05:00:14.383997 6825 tablet_bootstrap.cc:492] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: No bootstrap required, opened a new log
I20260807 05:00:14.384176 6824 consensus_queue.cc:260] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.384452 6824 ts_tablet_manager.cc:1428] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:14.384728 6825 ts_tablet_manager.cc:1397] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260807 05:00:14.385159 6825 raft_consensus.cc:348] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.385268 6825 raft_consensus.cc:374] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:14.385298 6825 raft_consensus.cc:729] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71a4bba66b44bfab29663ff20bb96f8, State: Initialized, Role: FOLLOWER
I20260807 05:00:14.385454 6825 consensus_queue.cc:260] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.385708 6825 ts_tablet_manager.cc:1428] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 05:00:14.594063 6862 raft_consensus.cc:482] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:14.594213 6862 raft_consensus.cc:504] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.594657 6862 leader_election.cc:288] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493), 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:14.595148 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4409f4736b204cd48c521058a705032c" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8" is_pre_election: true
I20260807 05:00:14.595166 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4409f4736b204cd48c521058a705032c" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" is_pre_election: true
I20260807 05:00:14.595294 6465 raft_consensus.cc:2454] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 0.
I20260807 05:00:14.595329 6710 raft_consensus.cc:2454] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 0.
I20260807 05:00:14.595585 6140 leader_election.cc:302] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, c71a4bba66b44bfab29663ff20bb96f8; no voters:
I20260807 05:00:14.595789 6862 raft_consensus.cc:2781] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:14.595856 6862 raft_consensus.cc:482] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:14.595896 6862 raft_consensus.cc:3037] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.596930 6862 raft_consensus.cc:504] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.597258 6862 leader_election.cc:288] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 election: Requested vote from peers c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493), 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:14.597609 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4409f4736b204cd48c521058a705032c" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
I20260807 05:00:14.597630 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4409f4736b204cd48c521058a705032c" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8"
I20260807 05:00:14.597711 6710 raft_consensus.cc:3037] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.597741 6465 raft_consensus.cc:3037] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.598564 6710 raft_consensus.cc:2454] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 1.
I20260807 05:00:14.598812 6138 leader_election.cc:302] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7; no voters:
I20260807 05:00:14.598872 6465 raft_consensus.cc:2454] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 1.
I20260807 05:00:14.598973 6862 raft_consensus.cc:2781] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:14.599050 6862 raft_consensus.cc:686] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 1 LEADER]: Becoming Leader. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Running, Role: LEADER
I20260807 05:00:14.599193 6862 consensus_queue.cc:237] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.601094 6005 catalog_manager.cc:5495] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08a8a44f333a44b198319c45f06abb0c (127.25.214.193). New cstate: current_term: 1 leader_uuid: "08a8a44f333a44b198319c45f06abb0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:14.623052 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.620427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42884 (local address 127.25.214.193:42085)
0807 05:00:14.620588 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:14.620592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:14.620606 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:14.620652 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:14.620654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:14.620696 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:14.620758 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:14.620952 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.621442 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.622187 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:14.622440 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:14.622553 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:14.622711 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:14.622780 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:14.622829 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:14.622902 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 05:00:14.622942 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 05:00:14.625077 6710 raft_consensus.cc:1261] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Refusing update from remote peer 08a8a44f333a44b198319c45f06abb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.625088 6465 raft_consensus.cc:1261] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Refusing update from remote peer 08a8a44f333a44b198319c45f06abb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.625507 6862 consensus_queue.cc:1035] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.625661 6830 consensus_queue.cc:1035] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.634056 6006 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:14.634215 6006 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:14.636159 6006 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Sending DeleteTablet for 3 replicas of tablet 4409f4736b204cd48c521058a705032c
I20260807 05:00:14.636730 6219 tablet_service.cc:1514] Processing DeleteTablet for tablet 4409f4736b204cd48c521058a705032c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42858
I20260807 05:00:14.636924 6684 tablet_service.cc:1514] Processing DeleteTablet for tablet 4409f4736b204cd48c521058a705032c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:47674
I20260807 05:00:14.636956 6442 tablet_service.cc:1514] Processing DeleteTablet for tablet 4409f4736b204cd48c521058a705032c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:58038
I20260807 05:00:14.637111 6906 tablet_replica.cc:330] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: stopping tablet replica
I20260807 05:00:14.637120 6907 tablet_replica.cc:330] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: stopping tablet replica
I20260807 05:00:14.637141 6855 tablet_replica.cc:330] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: stopping tablet replica
I20260807 05:00:14.637243 6906 raft_consensus.cc:2229] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:14.637243 6907 raft_consensus.cc:2229] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:14.637259 6855 raft_consensus.cc:2229] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:14.637374 6906 raft_consensus.cc:2258] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.637372 6907 raft_consensus.cc:2258] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.637455 6855 raft_consensus.cc:2258] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.638075 6906 ts_tablet_manager.cc:1905] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.638180 6907 ts_tablet_manager.cc:1905] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.638397 6855 ts_tablet_manager.cc:1905] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.640362 6855 ts_tablet_manager.cc:1918] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:14.640439 6855 log.cc:1196] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/4409f4736b204cd48c521058a705032c
I20260807 05:00:14.640550 6907 ts_tablet_manager.cc:1918] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:14.640573 6906 ts_tablet_manager.cc:1918] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:14.640635 6906 log.cc:1196] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/4409f4736b204cd48c521058a705032c
I20260807 05:00:14.640635 6907 log.cc:1196] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/4409f4736b204cd48c521058a705032c
I20260807 05:00:14.640678 6855 ts_tablet_manager.cc:1939] T 4409f4736b204cd48c521058a705032c P 08a8a44f333a44b198319c45f06abb0c: Deleting consensus metadata
I20260807 05:00:14.640892 6907 ts_tablet_manager.cc:1939] T 4409f4736b204cd48c521058a705032c P c71a4bba66b44bfab29663ff20bb96f8: Deleting consensus metadata
I20260807 05:00:14.640911 6906 ts_tablet_manager.cc:1939] T 4409f4736b204cd48c521058a705032c P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting consensus metadata
I20260807 05:00:14.641322 5985 catalog_manager.cc:4841] TS 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085): tablet 4409f4736b204cd48c521058a705032c (table test-table [id=e96ac76c29c04e70b234820057c03c97]) successfully deleted
I20260807 05:00:14.641489 5980 catalog_manager.cc:4841] TS 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953): tablet 4409f4736b204cd48c521058a705032c (table test-table [id=e96ac76c29c04e70b234820057c03c97]) successfully deleted
I20260807 05:00:14.641603 5982 catalog_manager.cc:4841] TS c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493): tablet 4409f4736b204cd48c521058a705032c (table test-table [id=e96ac76c29c04e70b234820057c03c97]) successfully deleted
I20260807 05:00:14.641855 6006 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:14.642238 6006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:14.646360 6219 tablet_service.cc:1467] Processing CreateTablet for tablet da7ce82c7f1f47d690adc7e43a975e6b (DEFAULT_TABLE table=test-table [id=3f8012aa8d144d358cc6c81ac53fa685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:14.646442 6442 tablet_service.cc:1467] Processing CreateTablet for tablet da7ce82c7f1f47d690adc7e43a975e6b (DEFAULT_TABLE table=test-table [id=3f8012aa8d144d358cc6c81ac53fa685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:14.646592 6684 tablet_service.cc:1467] Processing CreateTablet for tablet da7ce82c7f1f47d690adc7e43a975e6b (DEFAULT_TABLE table=test-table [id=3f8012aa8d144d358cc6c81ac53fa685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:14.646674 6219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7ce82c7f1f47d690adc7e43a975e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:14.646703 6442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7ce82c7f1f47d690adc7e43a975e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:14.646806 6684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7ce82c7f1f47d690adc7e43a975e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:14.648427 6823 tablet_bootstrap.cc:492] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: Bootstrap starting.
I20260807 05:00:14.648885 6824 tablet_bootstrap.cc:492] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Bootstrap starting.
I20260807 05:00:14.648885 6825 tablet_bootstrap.cc:492] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Bootstrap starting.
I20260807 05:00:14.649245 6823 tablet_bootstrap.cc:654] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:14.649626 6824 tablet_bootstrap.cc:654] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:14.649660 6825 tablet_bootstrap.cc:654] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:14.650746 6825 tablet_bootstrap.cc:492] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: No bootstrap required, opened a new log
I20260807 05:00:14.650775 6824 tablet_bootstrap.cc:492] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: No bootstrap required, opened a new log
I20260807 05:00:14.650839 6825 ts_tablet_manager.cc:1397] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:14.650838 6824 ts_tablet_manager.cc:1397] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:14.651216 6824 raft_consensus.cc:348] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.651216 6825 raft_consensus.cc:348] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.651333 6825 raft_consensus.cc:374] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:14.651333 6824 raft_consensus.cc:374] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:14.651376 6824 raft_consensus.cc:729] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24ae0c6c6edb4b79ab6ced4cc1d62bf7, State: Initialized, Role: FOLLOWER
I20260807 05:00:14.651376 6825 raft_consensus.cc:729] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71a4bba66b44bfab29663ff20bb96f8, State: Initialized, Role: FOLLOWER
I20260807 05:00:14.651500 6824 consensus_queue.cc:260] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.651500 6825 consensus_queue.cc:260] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.651759 6824 ts_tablet_manager.cc:1428] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:14.651759 6825 ts_tablet_manager.cc:1428] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:14.652542 6823 tablet_bootstrap.cc:492] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: No bootstrap required, opened a new log
I20260807 05:00:14.652631 6823 ts_tablet_manager.cc:1397] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 05:00:14.653062 6823 raft_consensus.cc:348] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.653182 6823 raft_consensus.cc:374] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:14.653218 6823 raft_consensus.cc:729] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Initialized, Role: FOLLOWER
I20260807 05:00:14.653339 6823 consensus_queue.cc:260] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.653643 6823 ts_tablet_manager.cc:1428] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:00:14.873324 6830 raft_consensus.cc:482] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:14.873499 6830 raft_consensus.cc:504] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.873917 6830 leader_election.cc:288] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493), 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:14.874428 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ce82c7f1f47d690adc7e43a975e6b" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" is_pre_election: true
I20260807 05:00:14.874430 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ce82c7f1f47d690adc7e43a975e6b" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8" is_pre_election: true
I20260807 05:00:14.874583 6465 raft_consensus.cc:2454] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 0.
I20260807 05:00:14.874584 6710 raft_consensus.cc:2454] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 0.
I20260807 05:00:14.874950 6140 leader_election.cc:302] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7, c71a4bba66b44bfab29663ff20bb96f8; no voters:
I20260807 05:00:14.875149 6830 raft_consensus.cc:2781] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:14.875216 6830 raft_consensus.cc:482] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:14.875257 6830 raft_consensus.cc:3037] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.876436 6830 raft_consensus.cc:504] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.876798 6830 leader_election.cc:288] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 election: Requested vote from peers c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493), 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953)
I20260807 05:00:14.877229 6710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ce82c7f1f47d690adc7e43a975e6b" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7"
I20260807 05:00:14.877374 6710 raft_consensus.cc:3037] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.877353 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ce82c7f1f47d690adc7e43a975e6b" candidate_uuid: "08a8a44f333a44b198319c45f06abb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c71a4bba66b44bfab29663ff20bb96f8"
I20260807 05:00:14.877482 6465 raft_consensus.cc:3037] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:14.878537 6465 raft_consensus.cc:2454] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 1.
I20260807 05:00:14.878537 6710 raft_consensus.cc:2454] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a8a44f333a44b198319c45f06abb0c in term 1.
I20260807 05:00:14.878830 6138 leader_election.cc:302] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8a44f333a44b198319c45f06abb0c, 24ae0c6c6edb4b79ab6ced4cc1d62bf7; no voters:
I20260807 05:00:14.879048 6830 raft_consensus.cc:2781] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:14.879135 6830 raft_consensus.cc:686] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 1 LEADER]: Becoming Leader. State: Replica: 08a8a44f333a44b198319c45f06abb0c, State: Running, Role: LEADER
I20260807 05:00:14.879278 6830 consensus_queue.cc:237] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } }
I20260807 05:00:14.880935 6006 catalog_manager.cc:5495] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08a8a44f333a44b198319c45f06abb0c (127.25.214.193). New cstate: current_term: 1 leader_uuid: "08a8a44f333a44b198319c45f06abb0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a8a44f333a44b198319c45f06abb0c" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:14.903636 6710 raft_consensus.cc:1261] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Refusing update from remote peer 08a8a44f333a44b198319c45f06abb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.903704 6465 raft_consensus.cc:1261] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Refusing update from remote peer 08a8a44f333a44b198319c45f06abb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:14.904114 6862 consensus_queue.cc:1035] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c71a4bba66b44bfab29663ff20bb96f8" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.904282 6830 consensus_queue.cc:1035] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24ae0c6c6edb4b79ab6ced4cc1d62bf7" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:14.935797 6004 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:14.935961 6004 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:14.937932 6004 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f71000b995dd412aa86beaf9f3b0e103: Sending DeleteTablet for 3 replicas of tablet da7ce82c7f1f47d690adc7e43a975e6b
I20260807 05:00:14.938426 6219 tablet_service.cc:1514] Processing DeleteTablet for tablet da7ce82c7f1f47d690adc7e43a975e6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42858
I20260807 05:00:14.938527 6442 tablet_service.cc:1514] Processing DeleteTablet for tablet da7ce82c7f1f47d690adc7e43a975e6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:58038
I20260807 05:00:14.938581 6684 tablet_service.cc:1514] Processing DeleteTablet for tablet da7ce82c7f1f47d690adc7e43a975e6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:14 UTC) from {username='oryx', principal='oryx/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:47674
I20260807 05:00:14.938699 6907 tablet_replica.cc:330] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: stopping tablet replica
I20260807 05:00:14.938763 6906 tablet_replica.cc:330] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: stopping tablet replica
I20260807 05:00:14.938779 6855 tablet_replica.cc:330] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: stopping tablet replica
I20260807 05:00:14.938817 6907 raft_consensus.cc:2229] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:14.938875 6855 raft_consensus.cc:2229] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:14.938907 6907 raft_consensus.cc:2258] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.938884 6906 raft_consensus.cc:2229] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:14.939020 6906 raft_consensus.cc:2258] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.939057 6855 raft_consensus.cc:2258] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:14.939788 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 6112
I20260807 05:00:14.939826 6855 ts_tablet_manager.cc:1905] T da7ce82c7f1f47d690adc7e43a975e6b P 08a8a44f333a44b198319c45f06abb0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.939839 6906 ts_tablet_manager.cc:1905] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.939911 6907 ts_tablet_manager.cc:1905] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:14.942022 6907 ts_tablet_manager.cc:1918] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 05:00:14.942076 6907 log.cc:1196] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/da7ce82c7f1f47d690adc7e43a975e6b
I20260807 05:00:14.942241 6907 ts_tablet_manager.cc:1939] T da7ce82c7f1f47d690adc7e43a975e6b P c71a4bba66b44bfab29663ff20bb96f8: Deleting consensus metadata
I20260807 05:00:14.942329 6906 ts_tablet_manager.cc:1918] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 05:00:14.942399 6906 log.cc:1196] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/da7ce82c7f1f47d690adc7e43a975e6b
I20260807 05:00:14.942627 6906 ts_tablet_manager.cc:1939] T da7ce82c7f1f47d690adc7e43a975e6b P 24ae0c6c6edb4b79ab6ced4cc1d62bf7: Deleting consensus metadata
I20260807 05:00:14.942945 5982 catalog_manager.cc:4841] TS c71a4bba66b44bfab29663ff20bb96f8 (127.25.214.194:36493): tablet da7ce82c7f1f47d690adc7e43a975e6b (table test-table [id=3f8012aa8d144d358cc6c81ac53fa685]) successfully deleted
I20260807 05:00:14.943210 5980 catalog_manager.cc:4841] TS 24ae0c6c6edb4b79ab6ced4cc1d62bf7 (127.25.214.195:41953): tablet da7ce82c7f1f47d690adc7e43a975e6b (table test-table [id=3f8012aa8d144d358cc6c81ac53fa685]) successfully deleted
W20260807 05:00:14.953097 5985 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:42085 (error 108)
I20260807 05:00:14.953986 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 6346
I20260807 05:00:14.954306 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:14.953897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42085 (local address 127.0.0.1:42886)
0807 05:00:14.954124 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:14.954199 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:42085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":62,"threads_started":1}
W20260807 05:00:14.966255 5985 catalog_manager.cc:4584] TS 08a8a44f333a44b198319c45f06abb0c (127.25.214.193:42085): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet da7ce82c7f1f47d690adc7e43a975e6b: Network error: Client connection negotiation failed: client connection to 127.25.214.193:42085: connect: Connection refused (error 111)
I20260807 05:00:14.973690 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 6568
I20260807 05:00:14.986452 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 5951
2026-08-07T05:00:14Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3550 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:15 dist-test-slave-lgr5 krb5kdc[6979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:15 dist-test-slave-lgr5 krb5kdc[6979](info): set up 2 sockets
Aug 07 05:00:15 dist-test-slave-lgr5 krb5kdc[6979](info): commencing operation
krb5kdc: starting...
W20260807 05:00:16.141268 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:16 dist-test-slave-lgr5 krb5kdc[6979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:00:16.260524 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:34109
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:34109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:16.370000 6997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:16.370263 6997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:16.370301 6997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:16.374159 6997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:16.374207 6997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:16.374225 6997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:16.374239 6997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:16.374258 6997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:16.379428 6997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:34109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:34109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:16.380439 6997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:16.381412 6997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:16.389181 7006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:16.389209 7008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:16.389205 7005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:16.389557 6997 server_base.cc:1034] running on GCE node
I20260807 05:00:16.390069 6997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:16.391063 6997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:16.392217 6997 hybrid_clock.cc:648] HybridClock initialized: now 1786078816392198 us; error 30 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T05:00:16Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1404 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:16 dist-test-slave-lgr5 krb5kdc[7015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:16 dist-test-slave-lgr5 krb5kdc[7015](info): set up 2 sockets
Aug 07 05:00:16 dist-test-slave-lgr5 krb5kdc[7015](info): commencing operation
krb5kdc: starting...
W20260807 05:00:17.534040 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:17 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:00:17.658867 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43907
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:17.773921 7031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:17.774233 7031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:17.774276 7031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:17.778499 7031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:17.778601 7031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:17.778620 7031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:17.778640 7031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:17.778653 7031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:17.784591 7031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:17.785804 7031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:17.786859 7031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:17.795728 7037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:17.795759 7041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:17.795732 7038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:17.795998 7031 server_base.cc:1034] running on GCE node
I20260807 05:00:17.796720 7031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:17.797870 7031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:17.799036 7031 hybrid_clock.cc:648] HybridClock initialized: now 1786078817799017 us; error 37 us; skew 500 ppm
Aug 07 05:00:17 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078817, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:17.801790 7031 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:00:17.802703 7031 webserver.cc:460] Webserver started at http://127.25.214.254:37353/ using document root <none> and password file <none>
I20260807 05:00:17.803282 7031 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:17.803352 7031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:17.803571 7031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:17.805757 7031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "7d6b4b3ae3f447ffa42186751db3c903"
format_stamp: "Formatted at 2026-08-07 05:00:17 on dist-test-slave-lgr5"
server_key: "66c27079c8e971d61563e99ee87bdaf0"
server_key_iv: "d324208ae10557758443a9e230cbfdd8"
server_key_version: "encryptionkey@0"
I20260807 05:00:17.806320 7031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "7d6b4b3ae3f447ffa42186751db3c903"
format_stamp: "Formatted at 2026-08-07 05:00:17 on dist-test-slave-lgr5"
server_key: "66c27079c8e971d61563e99ee87bdaf0"
server_key_iv: "d324208ae10557758443a9e230cbfdd8"
server_key_version: "encryptionkey@0"
I20260807 05:00:17.809999 7031 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 05:00:17.812455 7051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:17.813696 7031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:17.813838 7031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "7d6b4b3ae3f447ffa42186751db3c903"
format_stamp: "Formatted at 2026-08-07 05:00:17 on dist-test-slave-lgr5"
server_key: "66c27079c8e971d61563e99ee87bdaf0"
server_key_iv: "d324208ae10557758443a9e230cbfdd8"
server_key_version: "encryptionkey@0"
I20260807 05:00:17.814010 7031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:17.837529 7031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:17.840763 7031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:17.840930 7031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:17.848312 7031 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43907
I20260807 05:00:17.848333 7132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43907 every 8 connection(s)
I20260807 05:00:17.849396 7031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:17.852437 7135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:17.856285 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 7031
I20260807 05:00:17.856415 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:17.856680 26459 external_mini_cluster.cc:1428] Setting key 4ce85a53e2c35bfc3f49c3b4c251f0da
I20260807 05:00:17.858410 7135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Bootstrap starting.
I20260807 05:00:17.860932 7135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:17.861677 7135 log.cc:824] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:17.863816 7135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: No bootstrap required, opened a new log
I20260807 05:00:17.867338 7135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:17.867578 7135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:17.867645 7135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d6b4b3ae3f447ffa42186751db3c903, State: Initialized, Role: FOLLOWER
I20260807 05:00:17.868163 7135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:17.868316 7135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:17.868387 7135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:17.868491 7135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:17.869665 7135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
Aug 07 05:00:17 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:17.870015 7135 leader_election.cc:302] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d6b4b3ae3f447ffa42186751db3c903; no voters:
I20260807 05:00:17.870365 7135 leader_election.cc:288] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:17.870464 7143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:17.870692 7143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 LEADER]: Becoming Leader. State: Replica: 7d6b4b3ae3f447ffa42186751db3c903, State: Running, Role: LEADER
I20260807 05:00:17.871073 7143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:17.871824 7135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:17.872910 7144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d6b4b3ae3f447ffa42186751db3c903. Latest consensus state: current_term: 1 leader_uuid: "7d6b4b3ae3f447ffa42186751db3c903" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } } }
I20260807 05:00:17.872951 7145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d6b4b3ae3f447ffa42186751db3c903" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } } }
I20260807 05:00:17.873051 7144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:17.873059 7145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:17.873461 7155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:17.875995 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:17.858037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.25.214.254:43907)
0807 05:00:17.858447 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:17.858462 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:17.858499 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:00:17.859138 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:17.859156 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:17.859489 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:17.859760 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:17.860638 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:17.861668 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:17.862680 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:17.863141 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:17.863263 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:17.870497 (+ 7234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:17.870504 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:17.870524 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:17.870564 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:17.872525 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:17.873155 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:17.873162 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:17.873169 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:17.873324 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:17.873657 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:17.873660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:17.873661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:17.874216 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:17.874425 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:17.874746 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 05:00:17.875102 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":113,"threads_started":1}
I20260807 05:00:17.876950 7155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:17.883344 7155 catalog_manager.cc:1347] Generated new cluster ID: 98290c996eb74a0daa6ba71cc6672c4f
I20260807 05:00:17.883430 7155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:17.900125 7155 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:17.901130 7155 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:17.905195 7155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Generated new TSK 0
I20260807 05:00:17.905825 7155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:00:17.937269 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43907
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:18.057834 7177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:18.058148 7177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:18.058197 7177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:18.062316 7177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:18.062394 7177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:18.062460 7177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:18.067858 7177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:18.068994 7177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:18.070024 7177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:18.079732 7184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.079792 7183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.079749 7187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:18.080005 7177 server_base.cc:1034] running on GCE node
I20260807 05:00:18.080451 7177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:18.081080 7177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:18.082263 7177 hybrid_clock.cc:648] HybridClock initialized: now 1786078818082237 us; error 42 us; skew 500 ppm
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:18.085036 7177 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:00:18.085896 7177 webserver.cc:460] Webserver started at http://127.25.214.193:39409/ using document root <none> and password file <none>
I20260807 05:00:18.086439 7177 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:18.086501 7177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:18.086704 7177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:18.088833 7177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "fd63e9a809d6471097bc7f1dff18cd7d"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "ba2359638a18913b70b29cc965243574"
server_key_iv: "341738c3bde5f8b5b3df50b41cc14355"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.089395 7177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "fd63e9a809d6471097bc7f1dff18cd7d"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "ba2359638a18913b70b29cc965243574"
server_key_iv: "341738c3bde5f8b5b3df50b41cc14355"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.093318 7177 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 05:00:18.095827 7196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.097149 7177 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:18.097271 7177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "fd63e9a809d6471097bc7f1dff18cd7d"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "ba2359638a18913b70b29cc965243574"
server_key_iv: "341738c3bde5f8b5b3df50b41cc14355"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.097378 7177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:18.143054 7177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:18.146239 7177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:18.146462 7177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:18.147117 7177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:18.147976 7177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:18.148025 7177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.148105 7177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:18.148138 7177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.156769 7177 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:40073
I20260807 05:00:18.156792 7372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:40073 every 8 connection(s)
I20260807 05:00:18.157650 7177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:18.165333 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 7177
I20260807 05:00:18.165477 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:18.165767 26459 external_mini_cluster.cc:1428] Setting key 90097349a032bb115a98b6e34f0e1f5e
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:18.170670 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:18.159413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:36367 (local address 127.25.214.254:43907)
0807 05:00:18.159555 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:18.159559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:18.160384 (+ 825us) server_negotiation.cc:407] Connection header received
0807 05:00:18.161697 (+ 1313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:18.161700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:18.161750 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:18.161823 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:18.162930 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.163461 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.164561 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.164777 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.164847 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:18.167385 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:18.167389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:18.167391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:18.167415 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:18.168698 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:18.169181 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:18.169183 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:18.169185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:18.169262 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:18.169581 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:18.169584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:18.169586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:18.169767 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:18.169853 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:18.170354 (+ 501us) server_negotiation.cc:299] Negotiation successful
0807 05:00:18.170500 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:00:18.171610 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:18.159769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:36367)
0807 05:00:18.160238 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:18.160280 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:18.161504 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:18.161968 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:18.161974 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:18.162311 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:18.162808 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:18.162821 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.163553 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.163556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:18.164458 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:18.164467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.164884 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.164886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:18.165022 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:18.165625 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:18.165641 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:18.167216 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:18.168806 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:18.168812 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:18.168826 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:18.169083 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:18.169347 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:18.169350 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:18.169352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:18.169491 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:18.169875 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:18.169881 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:18.170125 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 05:00:18.170294 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 05:00:18.170614 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":117,"threads_started":1}
I20260807 05:00:18.172919 7375 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43907
I20260807 05:00:18.173161 7375 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:18.173705 7375 heartbeater.cc:511] Master 127.25.214.254:43907 requested a full tablet report, sending...
I20260807 05:00:18.175230 7083 ts_manager.cc:194] Registered new tserver with Master: fd63e9a809d6471097bc7f1dff18cd7d (127.25.214.193:40073)
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:00:18.176563 7083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:36367
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:00:18.193229 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43907
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:18.304987 7384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:18.305248 7384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:18.305305 7384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:18.309221 7384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:18.309274 7384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:18.309352 7384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:18.314499 7384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:18.315558 7384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:18.316584 7384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:18.326144 7392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.326148 7390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:18.326205 7384 server_base.cc:1034] running on GCE node
W20260807 05:00:18.326148 7395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:18.326812 7384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:18.327512 7384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:18.328684 7384 hybrid_clock.cc:648] HybridClock initialized: now 1786078818328656 us; error 43 us; skew 500 ppm
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:18.331422 7384 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:00:18.332365 7384 webserver.cc:460] Webserver started at http://127.25.214.194:45327/ using document root <none> and password file <none>
I20260807 05:00:18.332924 7384 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:18.333004 7384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:18.333276 7384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:18.335382 7384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "292634199a4a4b5ead939135b5f67158"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "4c0225b49e9a0061f3d00301671c8412"
server_key_iv: "df1d59d0d07604de85e6fe079548c03b"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.335913 7384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "292634199a4a4b5ead939135b5f67158"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "4c0225b49e9a0061f3d00301671c8412"
server_key_iv: "df1d59d0d07604de85e6fe079548c03b"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.339529 7384 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:18.341869 7408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.343053 7384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:18.343183 7384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "292634199a4a4b5ead939135b5f67158"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "4c0225b49e9a0061f3d00301671c8412"
server_key_iv: "df1d59d0d07604de85e6fe079548c03b"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.343282 7384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:18.354414 7384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:18.357616 7384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:18.357800 7384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:18.358415 7384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:18.359275 7384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:18.359324 7384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.359380 7384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:18.359406 7384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.368343 7384 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:39367
I20260807 05:00:18.368371 7598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:39367 every 8 connection(s)
I20260807 05:00:18.369238 7384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:18.369634 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 7384
I20260807 05:00:18.369777 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:18.370111 26459 external_mini_cluster.cc:1428] Setting key 66280f9eb4b02a4bd9fa292b4d36ae38
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 05:00:18.383173 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:18.371179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:58129 (local address 127.25.214.254:43907)
0807 05:00:18.371311 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:18.371315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:18.372300 (+ 985us) server_negotiation.cc:407] Connection header received
0807 05:00:18.373753 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:18.373756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:18.373811 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:18.373905 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:18.375043 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.375576 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.376739 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.376961 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.377049 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:18.379752 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:18.379756 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:18.379759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:18.379792 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:18.381169 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:18.381705 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:18.381708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:18.381709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:18.381782 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:18.382048 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:18.382050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:18.382051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:18.382224 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:18.382294 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:18.382866 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 05:00:18.383005 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:00:18.383971 7603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:18.371626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:58129)
0807 05:00:18.372168 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:18.372216 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:18.373559 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:18.374065 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:18.374072 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:18.374422 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:18.374908 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:18.374922 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.375692 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.375695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:18.376624 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:18.376635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.377103 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.377107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:18.377268 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:18.377904 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:18.377922 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:18.379557 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:18.381299 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:18.381306 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:18.381323 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:18.381620 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:18.381845 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:18.381848 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:18.381849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:18.381984 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:18.382306 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:18.382313 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:18.382582 (+ 269us) client_negotiation.cc:769] Sending connection context
0807 05:00:18.382776 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 05:00:18.383089 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":139,"threads_started":1}
I20260807 05:00:18.385219 7600 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43907
I20260807 05:00:18.385500 7600 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:18.386121 7600 heartbeater.cc:511] Master 127.25.214.254:43907 requested a full tablet report, sending...
I20260807 05:00:18.387132 7083 ts_manager.cc:194] Registered new tserver with Master: 292634199a4a4b5ead939135b5f67158 (127.25.214.194:39367)
I20260807 05:00:18.387702 7083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:58129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:00:18.398690 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43907
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:18.517086 7606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:18.517375 7606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:18.517421 7606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:18.521636 7606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:18.521721 7606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:18.521785 7606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:18.527336 7606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:18.528577 7606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:18.529626 7606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:18.539892 7616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.539892 7613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.539892 7614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:18.540226 7606 server_base.cc:1034] running on GCE node
I20260807 05:00:18.540679 7606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:18.541348 7606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:18.542524 7606 hybrid_clock.cc:648] HybridClock initialized: now 1786078818542507 us; error 32 us; skew 500 ppm
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:18.545293 7606 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:00:18.546222 7606 webserver.cc:460] Webserver started at http://127.25.214.195:41815/ using document root <none> and password file <none>
I20260807 05:00:18.546778 7606 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:18.546846 7606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:18.547047 7606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:18.549177 7606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "edc505eea3334bdf9f222ae0a8311c93"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "6468a87863d683f78a20485511269e77"
server_key_iv: "0f56a20480e026566966783562442d06"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.549721 7606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "edc505eea3334bdf9f222ae0a8311c93"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "6468a87863d683f78a20485511269e77"
server_key_iv: "0f56a20480e026566966783562442d06"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.553511 7606 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:00:18.556062 7629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.557462 7606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:00:18.557613 7606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "edc505eea3334bdf9f222ae0a8311c93"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "6468a87863d683f78a20485511269e77"
server_key_iv: "0f56a20480e026566966783562442d06"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.557719 7606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:18.585587 7606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:18.588707 7606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:18.588879 7606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:18.589450 7606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:18.590314 7606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:18.590364 7606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.590410 7606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:18.590431 7606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.599682 7606 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:37351
I20260807 05:00:18.599709 7799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:37351 every 8 connection(s)
I20260807 05:00:18.600739 7606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:18.606254 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 7606
I20260807 05:00:18.606415 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:18.606770 26459 external_mini_cluster.cc:1428] Setting key 4e42825249fca9dda00a627f3b0cb45d
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:18.615401 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:18.602717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:53115 (local address 127.25.214.254:43907)
0807 05:00:18.602866 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:18.602870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:18.603711 (+ 841us) server_negotiation.cc:407] Connection header received
0807 05:00:18.605171 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:18.605175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:18.605239 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:18.605317 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:18.606728 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.607406 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.608819 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.609099 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.609201 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:18.611936 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:18.611940 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:18.611943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:18.611975 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:18.613325 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:18.613919 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:18.613922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:18.613923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:18.613999 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:18.614284 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:18.614286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:18.614287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:18.614505 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:18.614580 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:18.615123 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 05:00:18.615244 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 05:00:18.616330 7803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:18.603080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:53115)
0807 05:00:18.603547 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:18.603601 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:18.604952 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:18.605499 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:18.605507 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:18.605880 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:18.606545 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:18.606582 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.607543 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.607546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:18.608689 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:18.608702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:18.609272 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:18.609276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:18.609476 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:18.610099 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:18.610117 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:18.611713 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:18.613491 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:18.613497 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:18.613515 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:18.613827 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:18.614070 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:18.614072 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:18.614074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:18.614218 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:18.614586 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:18.614592 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:18.614873 (+ 281us) client_negotiation.cc:769] Sending connection context
0807 05:00:18.615048 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 05:00:18.615364 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":121,"threads_started":1}
I20260807 05:00:18.617555 7800 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43907
I20260807 05:00:18.617810 7800 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:18.618374 7800 heartbeater.cc:511] Master 127.25.214.254:43907 requested a full tablet report, sending...
I20260807 05:00:18.619590 7083 ts_manager.cc:194] Registered new tserver with Master: edc505eea3334bdf9f222ae0a8311c93 (127.25.214.195:37351)
I20260807 05:00:18.620330 7083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:53115
I20260807 05:00:18.620764 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab.
Entry for principal oryx/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab.
WARNING: no policy specified for oryx/127.25.214.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab.
Entry for principal oryx/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab.
WARNING: no policy specified for oryx/127.25.214.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab.
Entry for principal oryx/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab.
I20260807 05:00:18.695030 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 7177
I20260807 05:00:18.711575 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 7384
I20260807 05:00:18.720646 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 7606
I20260807 05:00:18.738734 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 7031
I20260807 05:00:18.750726 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43907
--webserver_interface=127.25.214.254
--webserver_port=37353
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:18.863634 7812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:18.863929 7812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:18.863988 7812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:18.868024 7812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:18.868112 7812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:18.868141 7812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:18.868162 7812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:18.868188 7812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:18.873479 7812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=37353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:18.874571 7812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:18.875641 7812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:18.884020 7820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.884066 7819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:18.884025 7823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:18.884413 7812 server_base.cc:1034] running on GCE node
I20260807 05:00:18.884971 7812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:18.886010 7812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:18.887164 7812 hybrid_clock.cc:648] HybridClock initialized: now 1786078818887139 us; error 37 us; skew 500 ppm
Aug 07 05:00:18 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078818, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:18.889755 7812 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:00:18.890580 7812 webserver.cc:460] Webserver started at http://127.25.214.254:37353/ using document root <none> and password file <none>
I20260807 05:00:18.891098 7812 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:18.891177 7812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:18.894855 7812 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:18.896878 7834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:18.898020 7812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:18.898133 7812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "7d6b4b3ae3f447ffa42186751db3c903"
format_stamp: "Formatted at 2026-08-07 05:00:17 on dist-test-slave-lgr5"
server_key: "66c27079c8e971d61563e99ee87bdaf0"
server_key_iv: "d324208ae10557758443a9e230cbfdd8"
server_key_version: "encryptionkey@0"
I20260807 05:00:18.898633 7812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:18.917971 7812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:18.920637 7812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:18.920809 7812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:18.927451 7812 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43907
I20260807 05:00:18.927469 7916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43907 every 8 connection(s)
I20260807 05:00:18.928514 7812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:18.932770 7919 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:00:18.934355 7919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Bootstrap starting.
I20260807 05:00:18.937294 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 7812
I20260807 05:00:18.937839 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:40073
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:43907
--webserver_port=39409
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:00:18.951602 7919 log.cc:824] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:18.958967 7919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:00:18.959340 7919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Bootstrap complete.
I20260807 05:00:18.963464 7919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:18.963879 7919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d6b4b3ae3f447ffa42186751db3c903, State: Initialized, Role: FOLLOWER
I20260807 05:00:18.964455 7919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:18.964594 7919 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:18.964664 7919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:18.964761 7919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 1 FOLLOWER]: Advancing to term 2
I20260807 05:00:18.966717 7919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:18.967046 7919 leader_election.cc:302] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d6b4b3ae3f447ffa42186751db3c903; no voters:
I20260807 05:00:18.967383 7919 leader_election.cc:288] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 05:00:18.967499 7929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 05:00:18.967706 7929 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [term 2 LEADER]: Becoming Leader. State: Replica: 7d6b4b3ae3f447ffa42186751db3c903, State: Running, Role: LEADER
I20260807 05:00:18.968024 7929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } }
I20260807 05:00:18.968782 7919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:18.969106 7931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d6b4b3ae3f447ffa42186751db3c903. Latest consensus state: current_term: 2 leader_uuid: "7d6b4b3ae3f447ffa42186751db3c903" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } } }
I20260807 05:00:18.969244 7931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:18.969897 7930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7d6b4b3ae3f447ffa42186751db3c903" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6b4b3ae3f447ffa42186751db3c903" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43907 } } }
I20260807 05:00:18.969995 7930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:18.970728 7935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:18.974217 7935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:18.974885 7935 catalog_manager.cc:1259] Loaded cluster ID: 98290c996eb74a0daa6ba71cc6672c4f
I20260807 05:00:18.974947 7935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:18.977368 7935 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:18.978125 7935 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7d6b4b3ae3f447ffa42186751db3c903: Loaded TSK: 0
I20260807 05:00:18.979379 7935 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 05:00:19.055945 7924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:19.056249 7924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:19.056301 7924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:19.060411 7924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:19.060484 7924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:19.060550 7924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:19.065945 7924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.193.keytab
--principal=oryx/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:40073
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=39409
--tserver_master_addrs=127.25.214.254:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:19.066968 7924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:19.068248 7924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:19.077569 7965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:19.077582 7964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:19.077625 7968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:19.077816 7924 server_base.cc:1034] running on GCE node
I20260807 05:00:19.078337 7924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:19.079113 7924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:19.080307 7924 hybrid_clock.cc:648] HybridClock initialized: now 1786078819080284 us; error 31 us; skew 500 ppm
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:19.083647 7924 init.cc:377] Logged in from keytab as oryx/127.25.214.193@KRBTEST.COM (short username oryx)
I20260807 05:00:19.084823 7924 webserver.cc:460] Webserver started at http://127.25.214.193:39409/ using document root <none> and password file <none>
I20260807 05:00:19.085512 7924 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:19.085614 7924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:19.090173 7924 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:00:19.092646 7976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.094074 7924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:00:19.094189 7924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "fd63e9a809d6471097bc7f1dff18cd7d"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "ba2359638a18913b70b29cc965243574"
server_key_iv: "341738c3bde5f8b5b3df50b41cc14355"
server_key_version: "encryptionkey@0"
I20260807 05:00:19.094884 7924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:19.125218 7924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:19.128247 7924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:19.128402 7924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:19.128964 7924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:19.129765 7924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:19.129812 7924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.129851 7924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:19.129868 7924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.138688 7924 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:40073
I20260807 05:00:19.138756 8148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:40073 every 8 connection(s)
I20260807 05:00:19.139672 7924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:19.145637 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 7924
I20260807 05:00:19.146106 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:39367
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:43907
--webserver_port=45327
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 05:00:19.153411 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.141769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45125 (local address 127.25.214.254:43907)
0807 05:00:19.142215 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.142231 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.142540 (+ 309us) server_negotiation.cc:407] Connection header received
0807 05:00:19.144070 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.144110 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.144429 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.144702 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.145833 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.146886 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.148068 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.148579 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.148738 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.152537 (+ 3799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:45125: BlockingRecv error: recv got EOF from 127.25.214.193:45125 (error 108)
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":104,"threads_started":1}
I20260807 05:00:19.153486 8152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.141890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:45125)
0807 05:00:19.142379 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.142431 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.143713 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.144803 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.144810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.145170 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.145653 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.145667 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.147032 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.147035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.147936 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.147947 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.148747 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.148752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.148928 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.149513 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.149529 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.152292 (+ 2763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":140,"threads_started":1}
W20260807 05:00:19.154296 8149 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:43907 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.214.254:43907: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.160034 8152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.154853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:50615)
0807 05:00:19.154976 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.154991 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.155103 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.155358 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.155361 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.155559 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.155673 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.155679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.156510 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.156514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.157075 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.157084 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.157525 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.157529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.157639 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.158173 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.158183 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.159892 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 05:00:19.160202 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.154979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50615 (local address 127.25.214.254:43907)
0807 05:00:19.155133 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.155138 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.155167 (+ 29us) server_negotiation.cc:407] Connection header received
0807 05:00:19.155217 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.155219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.155264 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.155330 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.155793 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.156399 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.157197 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.157418 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.157508 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.160062 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:50615: BlockingRecv error: recv got EOF from 127.25.214.193:50615 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.165580 8152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.160854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:50671)
0807 05:00:19.160967 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.160981 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.161070 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.161283 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.161286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.161425 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.161499 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.161504 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.162191 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.162194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.162700 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.162708 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.163112 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.163115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.163193 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.163655 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.163666 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.165436 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 05:00:19.165676 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.160949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50671 (local address 127.25.214.254:43907)
0807 05:00:19.161074 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.161078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.161092 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:19.161150 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.161153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.161195 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.161257 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.161608 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.162092 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.162807 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.163011 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.163095 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.165572 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:50671: BlockingRecv error: recv got EOF from 127.25.214.193:50671 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 05:00:19.166045 8149 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:00:19.263423 8155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:19.263712 8155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:19.263758 8155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:19.267757 8155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:19.267815 8155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:19.267871 8155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:19.273298 8155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.194.keytab
--principal=oryx/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:39367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=45327
--tserver_master_addrs=127.25.214.254:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:19.274298 8155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:19.275279 8155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:19.284655 8163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:19.284642 8160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:19.284642 8161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:19.284740 8155 server_base.cc:1034] running on GCE node
I20260807 05:00:19.285297 8155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:19.285934 8155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:19.287082 8155 hybrid_clock.cc:648] HybridClock initialized: now 1786078819287060 us; error 41 us; skew 500 ppm
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:19.289837 8155 init.cc:377] Logged in from keytab as oryx/127.25.214.194@KRBTEST.COM (short username oryx)
I20260807 05:00:19.290726 8155 webserver.cc:460] Webserver started at http://127.25.214.194:45327/ using document root <none> and password file <none>
I20260807 05:00:19.291275 8155 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:19.291347 8155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:19.295300 8155 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:00:19.297447 8176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.298663 8155 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:19.298774 8155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "292634199a4a4b5ead939135b5f67158"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "4c0225b49e9a0061f3d00301671c8412"
server_key_iv: "df1d59d0d07604de85e6fe079548c03b"
server_key_version: "encryptionkey@0"
I20260807 05:00:19.299328 8155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:19.319567 8155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:19.322849 8155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:19.323050 8155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:19.323680 8155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:19.324609 8155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:19.324658 8155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.324705 8155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:19.324734 8155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.333859 8155 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:39367
I20260807 05:00:19.333885 8359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:39367 every 8 connection(s)
I20260807 05:00:19.334924 8155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:19.343403 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 8155
I20260807 05:00:19.343863 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:37351
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:43907
--webserver_port=41815
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 05:00:19.346355 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.336844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:52771 (local address 127.25.214.254:43907)
0807 05:00:19.336994 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.336999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.337897 (+ 898us) server_negotiation.cc:407] Connection header received
0807 05:00:19.339216 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.339218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.339273 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.339348 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.340572 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.341111 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.342219 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.342450 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.342525 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.346215 (+ 3690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:52771: BlockingRecv error: recv got EOF from 127.25.214.194:52771 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 05:00:19.347096 8364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.337288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:52771)
0807 05:00:19.337738 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.337781 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.339016 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.339510 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.339517 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.339877 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.340419 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.340435 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.341230 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.341233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.342128 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.342138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.342566 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.342568 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.342712 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.343349 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.343366 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.346047 (+ 2681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":109,"threads_started":1}
W20260807 05:00:19.347749 8360 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:43907 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.214.254:43907: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.353638 8364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.348281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:53495)
0807 05:00:19.348400 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.348415 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.348512 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.348746 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.348748 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.348897 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.348999 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.349004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.350015 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.350018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.350568 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.350576 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.351107 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.351109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.351172 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.351652 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.351664 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.353478 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 05:00:19.353715 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.348369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:53495 (local address 127.25.214.254:43907)
0807 05:00:19.348515 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.348520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.348537 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:00:19.348588 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.348591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.348643 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.348742 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.349121 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.349909 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.350676 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.351006 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.351116 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.353606 (+ 2490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:53495: BlockingRecv error: recv got EOF from 127.25.214.194:53495 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.359134 8364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.354343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:48123)
0807 05:00:19.354464 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.354479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.354560 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.354779 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.354781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.354922 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.354993 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.354998 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.355729 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.355731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.356283 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.356292 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.356704 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.356707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.356782 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.357221 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.357232 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.358993 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 05:00:19.359336 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.354405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:48123 (local address 127.25.214.254:43907)
0807 05:00:19.354508 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.354512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.354535 (+ 23us) server_negotiation.cc:407] Connection header received
0807 05:00:19.354645 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.354648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.354689 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.354751 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.355114 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.355626 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.356384 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.356607 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.356692 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.359118 (+ 2426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:48123: BlockingRecv error: recv got EOF from 127.25.214.194:48123 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 05:00:19.359450 8360 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:00:19.461659 8365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:19.461949 8365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:19.462011 8365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:19.466033 8365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:19.466099 8365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:19.466178 8365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:19.471727 8365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/krb5kdc/oryx_127.25.214.195.keytab
--principal=oryx/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:37351
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=41815
--tserver_master_addrs=127.25.214.254:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:19.472852 8365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:19.473881 8365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:19.483340 8375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:19.483372 8379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:19.483456 8365 server_base.cc:1034] running on GCE node
W20260807 05:00:19.483341 8377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:19.484007 8365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:19.484678 8365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:19.485841 8365 hybrid_clock.cc:648] HybridClock initialized: now 1786078819485819 us; error 33 us; skew 500 ppm
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:19.488579 8365 init.cc:377] Logged in from keytab as oryx/127.25.214.195@KRBTEST.COM (short username oryx)
I20260807 05:00:19.489460 8365 webserver.cc:460] Webserver started at http://127.25.214.195:41815/ using document root <none> and password file <none>
I20260807 05:00:19.490016 8365 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:19.490092 8365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:19.494019 8365 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:00:19.496124 8392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.497309 8365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:19.497409 8365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "edc505eea3334bdf9f222ae0a8311c93"
format_stamp: "Formatted at 2026-08-07 05:00:18 on dist-test-slave-lgr5"
server_key: "6468a87863d683f78a20485511269e77"
server_key_iv: "0f56a20480e026566966783562442d06"
server_key_version: "encryptionkey@0"
I20260807 05:00:19.497969 8365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:19.515810 8365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:19.519351 8365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:19.519572 8365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:19.520267 8365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:19.521199 8365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:19.521260 8365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.521317 8365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:19.521344 8365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:19.530129 8365 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:37351
I20260807 05:00:19.530177 8587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:37351 every 8 connection(s)
I20260807 05:00:19.531229 8365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:19.532326 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 8365
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.542222 8594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.533101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.25.214.254:43907)
0807 05:00:19.533819 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.533823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.533834 (+ 11us) server_negotiation.cc:407] Connection header received
0807 05:00:19.533876 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.533878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.533924 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.534003 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.534759 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.535312 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.536190 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.536415 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.536507 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.538113 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:19.538118 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:19.538131 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:19.538160 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:19.539946 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:19.540394 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:19.540400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:19.540407 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:19.540566 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:19.540808 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:19.540811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:19.540813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:19.541159 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:19.541338 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:19.541842 (+ 504us) server_negotiation.cc:299] Negotiation successful
0807 05:00:19.542085 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647}
W20260807 05:00:19.543021 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.533553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:34515 (local address 127.25.214.254:43907)
0807 05:00:19.534646 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.534651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.534666 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:00:19.535722 (+ 1056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.535725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.535773 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.535843 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.537064 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.537780 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.539011 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.539318 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.539426 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.542936 (+ 3510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:34515: BlockingRecv error: recv got EOF from 127.25.214.195:34515 (error 108)
Metrics: {"server-negotiator.queue_time_us":1014,"thread_start_us":108,"threads_started":1}
I20260807 05:00:19.543756 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.533724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:34515)
0807 05:00:19.534195 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.534247 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.535524 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.536010 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.536017 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.536385 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.536911 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.536931 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.537899 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.537902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.538896 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.538910 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.539470 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.539474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.539621 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.540161 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.540177 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.542840 (+ 2663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":106,"threads_started":1}
W20260807 05:00:19.544265 8588 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:43907 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.214.254:43907: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.549422 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.544673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:46921)
0807 05:00:19.544884 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.544898 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.545000 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.545217 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.545219 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.545347 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.545443 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.545448 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.546090 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.546092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.546633 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.546640 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.547100 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.547102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.547169 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.547627 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.547637 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.549307 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 05:00:19.549600 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.544745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:46921 (local address 127.25.214.254:43907)
0807 05:00:19.544841 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.544845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.544984 (+ 139us) server_negotiation.cc:407] Connection header received
0807 05:00:19.545095 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.545098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.545141 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.545196 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.545522 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.546016 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.546781 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.547002 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.547094 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.549465 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:46921: BlockingRecv error: recv got EOF from 127.25.214.195:46921 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:19 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:19.554700 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:19.549999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:37983)
0807 05:00:19.550105 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:19.550118 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:19.550205 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:19.550466 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:19.550469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:19.550625 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:19.550705 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.550711 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.551443 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.551448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.551972 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:19.551981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.552435 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.552439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:19.552515 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.552937 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:19.552947 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:19.554557 (+ 1610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 05:00:19.554808 8151 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:19.550082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:37983 (local address 127.25.214.254:43907)
0807 05:00:19.550266 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:19.550271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:19.550285 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:19.550328 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:19.550330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:19.550369 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:19.550444 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:19.550818 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.551333 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.552105 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:19.552329 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:19.552427 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:19.554702 (+ 2275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:37983: BlockingRecv error: recv got EOF from 127.25.214.195:37983 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
W20260807 05:00:19.554900 8588 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 05:00:20 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:20 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:20.172892 8597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:20.166769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:53681)
0807 05:00:20.167132 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:20.167146 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:20.167248 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:20.167534 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:20.167536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:20.167717 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:20.167818 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:20.167824 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.168982 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.168985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:20.169712 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:20.169726 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.170339 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.170343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:20.170431 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:20.170937 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:20.170951 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:20.172767 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":83,"threads_started":1}
W20260807 05:00:20.173108 8599 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:20.166894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:53681 (local address 127.25.214.254:43907)
0807 05:00:20.167175 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:20.167180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:20.167197 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:00:20.167340 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:20.167343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:20.167403 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:20.167520 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:20.167942 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.168841 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.169827 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.170200 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.170314 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:20.172955 (+ 2641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:53681: BlockingRecv error: recv got EOF from 127.25.214.193:53681 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":85,"threads_started":1}
Aug 07 05:00:20 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:20 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:20.365410 8600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:20.360161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:38595)
0807 05:00:20.360449 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:20.360463 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:20.360576 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:20.360828 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:20.360831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:20.361032 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:20.361128 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:20.361133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.361874 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.361878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:20.362454 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:20.362462 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.362891 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.362894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:20.362974 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:20.363439 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:20.363450 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:20.365238 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":83,"threads_started":1}
W20260807 05:00:20.365556 8599 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:20.360227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:38595 (local address 127.25.214.254:43907)
0807 05:00:20.360369 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:20.360374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:20.360543 (+ 169us) server_negotiation.cc:407] Connection header received
0807 05:00:20.360669 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:20.360672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:20.360722 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:20.360788 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:20.361244 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.361766 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.362568 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.362787 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.362882 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:20.365394 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:38595: BlockingRecv error: recv got EOF from 127.25.214.194:38595 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 05:00:20 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:20 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:20.561669 8601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:20.555651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:58601)
0807 05:00:20.555951 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:20.555969 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:20.556136 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:20.556440 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:20.556443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:20.556672 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:20.556778 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:20.556785 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.557572 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.557576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:20.558169 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:20.558178 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.558642 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.558647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:20.558731 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:20.559322 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:20.559339 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:20.561529 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":91,"threads_started":1}
W20260807 05:00:20.561866 8599 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:20.555767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:58601 (local address 127.25.214.254:43907)
0807 05:00:20.555951 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:20.555956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:20.556052 (+ 96us) server_negotiation.cc:407] Connection header received
0807 05:00:20.556242 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:20.556246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:20.556298 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:20.556401 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:20.556915 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.557455 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.558294 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:20.558526 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:20.558626 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:20.561705 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:58601: BlockingRecv error: recv got EOF from 127.25.214.195:58601 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 07 05:00:21 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:21 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:21.179411 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:21.173757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:41783)
0807 05:00:21.174097 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:21.174116 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:21.174261 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:21.174625 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:21.174629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:21.174868 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:21.175026 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:21.175036 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.175943 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.175946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:21.176552 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:21.176562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.176958 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.176960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:21.177032 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:21.177506 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:21.177517 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:21.179275 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":95,"threads_started":1}
W20260807 05:00:21.179564 8606 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:21.173902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:41783 (local address 127.25.214.254:43907)
0807 05:00:21.174131 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:21.174135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:21.174223 (+ 88us) server_negotiation.cc:407] Connection header received
0807 05:00:21.174378 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:21.174381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:21.174444 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:21.174549 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:21.175176 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.175841 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.176646 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.176871 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.176947 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:21.179428 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:41783: BlockingRecv error: recv got EOF from 127.25.214.193:41783 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":67,"threads_started":1}
Aug 07 05:00:21 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:21 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:21.371976 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:21.366379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:38543)
0807 05:00:21.366692 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:21.366707 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:21.366834 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:21.367082 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:21.367085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:21.367279 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:21.367396 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:21.367402 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.368210 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.368212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:21.368774 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:21.368783 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.369249 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.369251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:21.369320 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:21.369915 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:21.369928 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:21.371850 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":122,"threads_started":1}
W20260807 05:00:21.372175 8606 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:21.366441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:38543 (local address 127.25.214.254:43907)
0807 05:00:21.366620 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:21.366624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:21.366798 (+ 174us) server_negotiation.cc:407] Connection header received
0807 05:00:21.366925 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:21.366927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:21.366984 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:21.367052 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:21.367540 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.368109 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.368915 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.369144 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.369220 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:21.372024 (+ 2804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:38543: BlockingRecv error: recv got EOF from 127.25.214.194:38543 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 05:00:21 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:21 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:21.568534 8609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:21.562436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:48053)
0807 05:00:21.562802 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:21.562852 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:21.563002 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:21.563294 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:21.563297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:21.563521 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:21.563631 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:21.563638 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.564537 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.564542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:21.565115 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:21.565124 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.565598 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.565602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:21.565688 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:21.566227 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:21.566239 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:21.568313 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":117,"threads_started":1}
W20260807 05:00:21.568600 8606 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:21.562675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:48053 (local address 127.25.214.254:43907)
0807 05:00:21.562815 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:21.562820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:21.562936 (+ 116us) server_negotiation.cc:407] Connection header received
0807 05:00:21.563107 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:21.563111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:21.563169 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:21.563248 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:21.563765 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.564405 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.565239 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:21.565479 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:21.565579 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:21.568488 (+ 2909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:48053: BlockingRecv error: recv got EOF from 127.25.214.195:48053 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 05:00:22 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:22 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:22.185186 8610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:22.180188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:50825)
0807 05:00:22.180460 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:22.180474 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:22.180571 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:22.180779 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:22.180781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:22.180957 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:22.181057 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:22.181062 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.181802 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.181805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:22.182390 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:22.182400 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.182783 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.182785 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:22.182849 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:22.183337 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:22.183349 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:22.185071 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":74,"threads_started":1}
W20260807 05:00:22.185331 8611 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:22.180233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50825 (local address 127.25.214.254:43907)
0807 05:00:22.180467 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:22.180470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:22.180529 (+ 59us) server_negotiation.cc:407] Connection header received
0807 05:00:22.180636 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:22.180637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:22.180679 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:22.180755 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:22.181143 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.181677 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.182487 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.182704 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.182769 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:22.185206 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:50825: BlockingRecv error: recv got EOF from 127.25.214.193:50825 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":77,"threads_started":1}
Aug 07 05:00:22 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:22 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:22.378077 8612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:22.372729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:48805)
0807 05:00:22.373039 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:22.373055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:22.373181 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:22.373475 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:22.373478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:22.373708 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:22.373838 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:22.373846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.374637 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.374639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:22.375206 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:22.375214 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.375618 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.375621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:22.375691 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:22.376229 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:22.376241 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:22.377936 (+ 1695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
W20260807 05:00:22.378182 8611 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:22.372822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:48805 (local address 127.25.214.254:43907)
0807 05:00:22.372955 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:22.372960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:22.373145 (+ 185us) server_negotiation.cc:407] Connection header received
0807 05:00:22.373279 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:22.373281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:22.373344 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:22.373430 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:22.373964 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.374532 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.375295 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.375502 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.375580 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:22.378081 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:48805: BlockingRecv error: recv got EOF from 127.25.214.194:48805 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 05:00:22 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:22 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:22.574790 8613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:22.569409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:47199)
0807 05:00:22.569704 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:22.569719 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:22.569836 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:22.570113 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:22.570116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:22.570363 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:22.570466 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:22.570473 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.571219 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.571221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:22.571774 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:22.571782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.572209 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.572213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:22.572304 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:22.572829 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:22.572842 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:22.574596 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":104,"threads_started":1}
W20260807 05:00:22.574847 8611 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:22.569526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:47199 (local address 127.25.214.254:43907)
0807 05:00:22.569676 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:22.569681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:22.569788 (+ 107us) server_negotiation.cc:407] Connection header received
0807 05:00:22.569922 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:22.569925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:22.569976 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:22.570042 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:22.570597 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.571133 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.571858 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:22.572068 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:22.572197 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:22.574745 (+ 2548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:47199: BlockingRecv error: recv got EOF from 127.25.214.195:47199 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 05:00:23 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:23 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:23.194324 8616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:23.185978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:45779)
0807 05:00:23.186280 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:23.186294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:23.186399 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:23.186604 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:23.186606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:23.186783 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:23.186885 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:23.186889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.187650 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.187652 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:23.188226 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:23.188233 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.188648 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.188650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:23.188704 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:23.192300 (+ 3596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:23.192312 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:23.194164 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":111,"threads_started":1}
W20260807 05:00:23.194456 8620 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:23.186062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45779 (local address 127.25.214.254:43907)
0807 05:00:23.186302 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:23.186306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:23.186373 (+ 67us) server_negotiation.cc:407] Connection header received
0807 05:00:23.186470 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:23.186472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:23.186516 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:23.186593 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:23.187016 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.187562 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.188322 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.188564 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.188644 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:23.194314 (+ 5670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:45779: BlockingRecv error: recv got EOF from 127.25.214.193:45779 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":73,"threads_started":1}
Aug 07 05:00:23 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:23 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:23.384069 8623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:23.378870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:52951)
0807 05:00:23.379156 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:23.379170 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:23.379285 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:23.379541 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:23.379543 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:23.379742 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:23.379840 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:23.379846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.380656 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.380659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:23.381200 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:23.381209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.381642 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.381645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:23.381723 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:23.382219 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:23.382232 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:23.383918 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":80,"threads_started":1}
W20260807 05:00:23.384209 8620 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:23.378947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:52951 (local address 127.25.214.254:43907)
0807 05:00:23.379103 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:23.379108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:23.379239 (+ 131us) server_negotiation.cc:407] Connection header received
0807 05:00:23.379373 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:23.379376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:23.379426 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:23.379495 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:23.379966 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.380548 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.381314 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.381538 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.381628 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:23.384105 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:52951: BlockingRecv error: recv got EOF from 127.25.214.194:52951 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 05:00:23 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:23 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:23.581694 8625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:23.575825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:36721)
0807 05:00:23.576185 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:23.576198 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:23.576327 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:23.576591 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:23.576594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:23.576794 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:23.576892 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:23.576898 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.577915 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.577919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:23.578717 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:23.578731 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.579255 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.579258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:23.579322 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:23.579836 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:23.579850 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:23.581573 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":99,"threads_started":1}
W20260807 05:00:23.581811 8620 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:23.575910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:36721 (local address 127.25.214.254:43907)
0807 05:00:23.576073 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:23.576101 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:23.576279 (+ 178us) server_negotiation.cc:407] Connection header received
0807 05:00:23.576422 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:23.576426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:23.576474 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:23.576543 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:23.577010 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.577785 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.578833 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:23.579149 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:23.579236 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:23.581705 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:36721: BlockingRecv error: recv got EOF from 127.25.214.195:36721 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 05:00:24 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:24 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:24.200954 8628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:24.195357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:46961)
0807 05:00:24.195668 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:24.195686 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:24.195801 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:24.196132 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:24.196135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:24.196377 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:24.196502 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:24.196510 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.197438 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.197441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:24.198014 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:24.198022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.198433 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.198436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:24.198508 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:24.199023 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:24.199038 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:24.200829 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":80,"threads_started":1}
W20260807 05:00:24.201102 8629 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:24.195536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46961 (local address 127.25.214.254:43907)
0807 05:00:24.195865 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:24.195869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:24.195884 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:00:24.195928 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:24.195930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:24.195972 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:24.196073 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:24.196617 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.197341 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.198101 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.198318 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.198386 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:24.200971 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:46961: BlockingRecv error: recv got EOF from 127.25.214.193:46961 (error 108)
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":131,"threads_started":1}
Aug 07 05:00:24 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:24 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:24.390388 8630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:24.384991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:46205)
0807 05:00:24.385296 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:24.385313 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:24.385428 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:24.385703 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:24.385706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:24.385941 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:24.386045 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:24.386059 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.386820 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.386823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:24.387496 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:24.387506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.387886 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.387888 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:24.387952 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:24.388436 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:24.388447 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:24.390263 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":110,"threads_started":1}
W20260807 05:00:24.390553 8629 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:24.385179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:46205 (local address 127.25.214.254:43907)
0807 05:00:24.385327 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:24.385331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:24.385378 (+ 47us) server_negotiation.cc:407] Connection header received
0807 05:00:24.385523 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:24.385526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:24.385577 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:24.385635 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:24.386160 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.386700 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.387598 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.387808 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.387879 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:24.390429 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:46205: BlockingRecv error: recv got EOF from 127.25.214.194:46205 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 05:00:24 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:24 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:24.587819 8632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:24.582600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:56809)
0807 05:00:24.582872 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:24.582885 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:24.582983 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:24.583220 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:24.583222 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:24.583402 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:24.583497 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:24.583503 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.584229 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.584232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:24.584819 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:24.584828 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.585277 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.585280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:24.585345 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:24.585818 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:24.585829 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:24.587666 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
W20260807 05:00:24.587875 8629 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:24.582698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:56809 (local address 127.25.214.254:43907)
0807 05:00:24.582849 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:24.582853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:24.582950 (+ 97us) server_negotiation.cc:407] Connection header received
0807 05:00:24.583064 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:24.583067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:24.583117 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:24.583192 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:24.583588 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.584139 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.584938 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:24.585162 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:24.585243 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:24.587778 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:56809: BlockingRecv error: recv got EOF from 127.25.214.195:56809 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 05:00:25 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:25 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:25.207679 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:25.201797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:45411)
0807 05:00:25.202104 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:25.202120 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:25.202238 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:25.202475 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:25.202478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:25.202764 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:25.202884 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:25.202891 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.203812 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.203815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:25.204625 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:25.204637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.205080 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.205083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:25.205147 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:25.205656 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:25.205668 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:25.207537 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":94,"threads_started":1}
W20260807 05:00:25.207870 8635 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:25.201834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45411 (local address 127.25.214.254:43907)
0807 05:00:25.202121 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:25.202125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:25.202192 (+ 67us) server_negotiation.cc:407] Connection header received
0807 05:00:25.202317 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:25.202319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:25.202366 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:25.202447 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:25.202987 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.203645 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.204726 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.204974 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.205061 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:25.207726 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:45411: BlockingRecv error: recv got EOF from 127.25.214.193:45411 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":75,"threads_started":1}
Aug 07 05:00:25 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:25 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:25.396390 8636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:25.391190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:43395)
0807 05:00:25.391464 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:25.391478 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:25.391596 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:25.391814 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:25.391816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:25.392011 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:25.392151 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:25.392157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.392849 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.392851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:25.393400 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:25.393407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.393768 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.393770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:25.393826 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:25.394341 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:25.394353 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:25.396236 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":85,"threads_started":1}
W20260807 05:00:25.396533 8635 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:25.391255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:43395 (local address 127.25.214.254:43907)
0807 05:00:25.391413 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:25.391418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:25.391582 (+ 164us) server_negotiation.cc:407] Connection header received
0807 05:00:25.391665 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:25.391667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:25.391716 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:25.391791 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:25.392237 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.392769 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.393476 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.393690 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.393756 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:25.396426 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:43395: BlockingRecv error: recv got EOF from 127.25.214.194:43395 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 05:00:25 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:25 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:25.594369 8637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:25.588812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:52923)
0807 05:00:25.589105 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:25.589123 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:25.589262 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:25.589558 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:25.589561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:25.589798 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:25.589928 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:25.589937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.590797 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.590800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:25.591353 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:25.591361 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.591800 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.591803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:25.591881 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:25.592365 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:25.592388 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:25.594219 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":93,"threads_started":1}
W20260807 05:00:25.594491 8635 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:25.588950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:52923 (local address 127.25.214.254:43907)
0807 05:00:25.589127 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:25.589132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:25.589209 (+ 77us) server_negotiation.cc:407] Connection header received
0807 05:00:25.589385 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:25.589388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:25.589444 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:25.589520 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:25.590045 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.590685 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.591478 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:25.591697 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:25.591781 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:25.594383 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:52923: BlockingRecv error: recv got EOF from 127.25.214.195:52923 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 07 05:00:26 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:26 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:26.213873 8638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:26.208472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:49123)
0807 05:00:26.208800 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:26.208814 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:26.208908 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:26.209158 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:26.209160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:26.209340 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:26.209456 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:26.209462 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.210199 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.210202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:26.210805 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:26.210814 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.211252 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.211256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:26.211332 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:26.211799 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:26.211810 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:26.213719 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":74,"threads_started":1}
W20260807 05:00:26.214100 8639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:26.208584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:49123 (local address 127.25.214.254:43907)
0807 05:00:26.208838 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:26.208842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:26.208860 (+ 18us) server_negotiation.cc:407] Connection header received
0807 05:00:26.208988 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:26.208990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:26.209033 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:26.209115 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:26.209542 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.210083 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.210900 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.211133 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.211200 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:26.213857 (+ 2657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:49123: BlockingRecv error: recv got EOF from 127.25.214.193:49123 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":106,"threads_started":1}
Aug 07 05:00:26 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:26 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:26.402665 8640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:26.397149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:42025)
0807 05:00:26.397497 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:26.397511 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:26.397610 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:26.397827 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:26.397829 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:26.398009 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:26.398108 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:26.398113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.398802 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.398805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:26.399496 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:26.399509 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.400026 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.400030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:26.400143 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:26.400636 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:26.400648 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:26.402548 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":92,"threads_started":1}
W20260807 05:00:26.402796 8639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:26.397226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:42025 (local address 127.25.214.254:43907)
0807 05:00:26.397363 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:26.397366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:26.397573 (+ 207us) server_negotiation.cc:407] Connection header received
0807 05:00:26.397696 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:26.397698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:26.397743 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:26.397802 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:26.398190 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.398700 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.399664 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.399901 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.399996 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:26.402686 (+ 2690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:42025: BlockingRecv error: recv got EOF from 127.25.214.194:42025 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 05:00:26 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:26 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:26.600519 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:26.595271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:42591)
0807 05:00:26.595641 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:26.595655 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:26.595759 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:26.595983 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:26.595985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:26.596204 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:26.596303 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:26.596310 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.596994 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.596997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:26.597544 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:26.597551 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.597929 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.597932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:26.597998 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:26.598511 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:26.598524 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:26.600395 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":91,"threads_started":1}
W20260807 05:00:26.600672 8639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:26.595409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:42591 (local address 127.25.214.254:43907)
0807 05:00:26.595576 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:26.595580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:26.595725 (+ 145us) server_negotiation.cc:407] Connection header received
0807 05:00:26.595833 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:26.595836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:26.595885 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:26.595960 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:26.596396 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.596915 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.597621 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:26.597825 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:26.597902 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:26.600533 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:42591: BlockingRecv error: recv got EOF from 127.25.214.195:42591 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 05:00:27 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:27 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:27.220315 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:27.214716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:34429)
0807 05:00:27.215006 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:27.215020 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:27.215130 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:27.215381 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:27.215383 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:27.215566 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:27.215668 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:27.215674 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.216500 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.216504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:27.217078 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:27.217088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.217565 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.217571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:27.217632 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:27.218169 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:27.218181 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:27.220182 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":78,"threads_started":1}
W20260807 05:00:27.220486 8644 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:27.214901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:34429 (local address 127.25.214.254:43907)
0807 05:00:27.215149 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:27.215153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:27.215166 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:27.215210 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:27.215212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:27.215254 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:27.215360 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:27.215781 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.216375 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.217216 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.217473 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.217561 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:27.220349 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:34429: BlockingRecv error: recv got EOF from 127.25.214.193:34429 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":71,"threads_started":1}
Aug 07 05:00:27 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:27 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:27.409114 8645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:27.403410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:57483)
0807 05:00:27.403745 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:27.403757 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:27.403875 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:27.404143 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:27.404146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:27.404351 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:27.404454 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:27.404461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.405358 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.405362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:27.405928 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:27.405937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.406375 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.406379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:27.406470 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:27.406967 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:27.406979 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:27.408964 (+ 1985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":84,"threads_started":1}
W20260807 05:00:27.409271 8644 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:27.403503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:57483 (local address 127.25.214.254:43907)
0807 05:00:27.403651 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:27.403655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:27.403832 (+ 177us) server_negotiation.cc:407] Connection header received
0807 05:00:27.403976 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:27.403979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:27.404026 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:27.404118 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:27.404572 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.405251 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.406043 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.406271 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.406358 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:27.409132 (+ 2774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:57483: BlockingRecv error: recv got EOF from 127.25.214.194:57483 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 07 05:00:27 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:27 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:27.607246 8646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:27.601523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:55011)
0807 05:00:27.601856 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:27.601872 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:27.602015 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:27.602300 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:27.602303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:27.602517 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:27.602626 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:27.602633 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.603491 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.603495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:27.604175 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:27.604187 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.604639 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.604643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:27.604722 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:27.605247 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:27.605259 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:27.607083 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":99,"threads_started":1}
W20260807 05:00:27.607358 8644 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:27.601639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:55011 (local address 127.25.214.254:43907)
0807 05:00:27.601846 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:27.601851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:27.601993 (+ 142us) server_negotiation.cc:407] Connection header received
0807 05:00:27.602129 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:27.602132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:27.602187 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:27.602259 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:27.602760 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.603368 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.604293 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:27.604519 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:27.604619 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:27.607249 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:55011: BlockingRecv error: recv got EOF from 127.25.214.195:55011 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 07 05:00:28 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:28 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:28.230644 8647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:28.221184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:38791)
0807 05:00:28.221508 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:28.221525 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:28.221634 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:28.221862 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:28.221864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:28.222044 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:28.222142 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:28.222147 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.222882 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.222886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:28.223464 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:28.223473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.223915 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.223918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:28.224004 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:28.228588 (+ 4584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:28.228600 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:28.230457 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":84,"threads_started":1}
W20260807 05:00:28.230731 8648 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:28.221373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:38791 (local address 127.25.214.254:43907)
0807 05:00:28.221639 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:28.221643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:28.221657 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:28.221714 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:28.221716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:28.221760 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:28.221828 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:28.222229 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.222772 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.223585 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.223815 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.223895 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:28.230611 (+ 6716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:38791: BlockingRecv error: recv got EOF from 127.25.214.193:38791 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":78,"threads_started":1}
Aug 07 05:00:28 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:28 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:28.415504 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:28.410082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:52307)
0807 05:00:28.410372 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:28.410387 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:28.410487 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:28.410710 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:28.410712 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:28.410901 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:28.410999 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:28.411005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.411740 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.411743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:28.412391 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:28.412401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.412904 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.412907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:28.412977 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:28.413463 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:28.413474 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:28.415336 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":93,"threads_started":1}
W20260807 05:00:28.415634 8648 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:28.410172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:52307 (local address 127.25.214.254:43907)
0807 05:00:28.410332 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:28.410336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:28.410452 (+ 116us) server_negotiation.cc:407] Connection header received
0807 05:00:28.410564 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:28.410566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:28.410612 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:28.410689 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:28.411088 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.411633 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.412523 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.412770 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.412856 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:28.415527 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:52307: BlockingRecv error: recv got EOF from 127.25.214.194:52307 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 05:00:28 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:28 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:28.613768 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:28.608188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:47993)
0807 05:00:28.608449 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:28.608462 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:28.608574 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:28.608877 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:28.608881 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:28.609123 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:28.609254 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:28.609264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.610192 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.610195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:28.610747 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:28.610756 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.611128 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.611130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:28.611188 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:28.611658 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:28.611670 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:28.613610 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":78,"threads_started":1}
W20260807 05:00:28.613857 8648 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:28.608251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:47993 (local address 127.25.214.254:43907)
0807 05:00:28.608398 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:28.608402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:28.608532 (+ 130us) server_negotiation.cc:407] Connection header received
0807 05:00:28.608681 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:28.608684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:28.608732 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:28.608808 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:28.609376 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.610084 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.610837 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:28.611043 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:28.611118 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:28.613753 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:47993: BlockingRecv error: recv got EOF from 127.25.214.195:47993 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 05:00:29 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:29 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:29.236744 8652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:29.231489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:48095)
0807 05:00:29.231770 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:29.231784 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:29.231876 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:29.232144 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:29.232147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:29.232327 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:29.232450 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:29.232455 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.233184 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.233186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:29.233750 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:29.233758 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.234159 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.234162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:29.234222 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:29.234733 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:29.234747 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:29.236587 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":76,"threads_started":1}
W20260807 05:00:29.236831 8654 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:29.231571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:48095 (local address 127.25.214.254:43907)
0807 05:00:29.231801 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:29.231804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:29.231831 (+ 27us) server_negotiation.cc:407] Connection header received
0807 05:00:29.231962 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:29.231964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:29.232005 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:29.232100 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:29.232545 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.233099 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.233844 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.234069 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.234148 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:29.236715 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:48095: BlockingRecv error: recv got EOF from 127.25.214.193:48095 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
Aug 07 05:00:29 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:29 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:29.421425 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:29.416340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:49795)
0807 05:00:29.416628 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:29.416643 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:29.416747 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:29.416952 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:29.416954 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:29.417140 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:29.417239 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:29.417245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.417939 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.417942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:29.418511 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:29.418518 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.418883 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.418886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:29.418943 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:29.419423 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:29.419434 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:29.421241 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":76,"threads_started":1}
W20260807 05:00:29.421485 8654 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:29.416461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:49795 (local address 127.25.214.254:43907)
0807 05:00:29.416630 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:29.416633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:29.416697 (+ 64us) server_negotiation.cc:407] Connection header received
0807 05:00:29.416824 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:29.416826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:29.416868 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:29.416924 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:29.417322 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.417848 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.418597 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.418802 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.418867 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:29.421386 (+ 2519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:49795: BlockingRecv error: recv got EOF from 127.25.214.194:49795 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 05:00:29 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:29 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:29.620007 8657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:29.614655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:41009)
0807 05:00:29.614954 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:29.614968 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:29.615080 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:29.615310 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:29.615313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:29.615500 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:29.615610 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:29.615615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.616380 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.616383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:29.616943 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:29.616952 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.617398 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.617400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:29.617456 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:29.617979 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:29.617991 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:29.619845 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":105,"threads_started":1}
W20260807 05:00:29.620325 8654 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:29.614829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:41009 (local address 127.25.214.254:43907)
0807 05:00:29.614979 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:29.614983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:29.615042 (+ 59us) server_negotiation.cc:407] Connection header received
0807 05:00:29.615160 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:29.615162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:29.615207 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:29.615283 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:29.615717 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.616292 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.617067 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:29.617298 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:29.617380 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:29.619988 (+ 2608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:41009: BlockingRecv error: recv got EOF from 127.25.214.195:41009 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 05:00:30 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:30 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:30.242756 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:30.237635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:37805)
0807 05:00:30.237922 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:30.237935 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:30.238028 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:30.238261 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:30.238263 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:30.238442 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:30.238540 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:30.238545 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.239247 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.239249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:30.239808 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:30.239815 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.240266 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.240268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:30.240324 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:30.240828 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:30.240842 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:30.242599 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":93,"threads_started":1}
W20260807 05:00:30.242864 8660 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:30.237758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:37805 (local address 127.25.214.254:43907)
0807 05:00:30.238005 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:30.238010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:30.238025 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:00:30.238107 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:30.238110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:30.238155 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:30.238237 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:30.238641 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.239168 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.239908 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.240182 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.240263 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:30.242745 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:37805: BlockingRecv error: recv got EOF from 127.25.214.193:37805 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":85,"threads_started":1}
Aug 07 05:00:30 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:30 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:30.427227 8661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:30.422167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:43851)
0807 05:00:30.422445 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:30.422458 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:30.422558 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:30.422779 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:30.422781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:30.422966 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:30.423076 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:30.423081 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.423776 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.423778 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:30.424372 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:30.424380 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.424785 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.424787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:30.424843 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:30.425357 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:30.425369 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:30.427098 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":99,"threads_started":1}
W20260807 05:00:30.427380 8660 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:30.422243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:43851 (local address 127.25.214.254:43907)
0807 05:00:30.422399 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:30.422402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:30.422521 (+ 119us) server_negotiation.cc:407] Connection header received
0807 05:00:30.422634 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:30.422636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:30.422683 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:30.422753 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:30.423164 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.423697 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.424470 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.424697 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.424777 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:30.427252 (+ 2475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:43851: BlockingRecv error: recv got EOF from 127.25.214.194:43851 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 05:00:30 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:30 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:30.626103 8663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:30.620860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:58863)
0807 05:00:30.621152 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:30.621165 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:30.621263 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:30.621490 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:30.621492 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:30.621712 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:30.621813 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:30.621819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.622518 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.622520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:30.623078 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:30.623085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.623545 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.623547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:30.623605 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:30.624136 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:30.624152 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:30.625958 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":94,"threads_started":1}
W20260807 05:00:30.626223 8660 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:30.620938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:58863 (local address 127.25.214.254:43907)
0807 05:00:30.621062 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:30.621066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:30.621223 (+ 157us) server_negotiation.cc:407] Connection header received
0807 05:00:30.621351 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:30.621353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:30.621400 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:30.621467 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:30.621903 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.622439 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.623194 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:30.623451 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:30.623545 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:30.626101 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:58863: BlockingRecv error: recv got EOF from 127.25.214.195:58863 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 05:00:31 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:31 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:31.249289 8665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:31.243706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:44637)
0807 05:00:31.244022 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:31.244036 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:31.244174 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:31.244523 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:31.244525 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:31.244727 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:31.244827 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:31.244832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.245531 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.245533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:31.246091 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:31.246099 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.246598 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.246600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:31.246656 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:31.247149 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:31.247160 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:31.249143 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":95,"threads_started":1}
W20260807 05:00:31.249425 8666 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:31.243817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:44637 (local address 127.25.214.254:43907)
0807 05:00:31.244111 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:31.244115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:31.244131 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:00:31.244345 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:31.244348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:31.244408 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:31.244495 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:31.244921 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.245450 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.246229 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.246492 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.246584 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:31.249289 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:44637: BlockingRecv error: recv got EOF from 127.25.214.193:44637 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":80,"threads_started":1}
Aug 07 05:00:31 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:31 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:31.432999 8667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:31.428004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:35523)
0807 05:00:31.428307 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:31.428323 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:31.428446 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:31.428676 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:31.428678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:31.428861 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:31.428959 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:31.428964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.429633 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.429635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:31.430185 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:31.430191 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.430569 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.430572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:31.430630 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:31.431092 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:31.431103 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:31.432875 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":117,"threads_started":1}
W20260807 05:00:31.433156 8666 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:31.428103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:35523 (local address 127.25.214.254:43907)
0807 05:00:31.428252 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:31.428257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:31.428386 (+ 129us) server_negotiation.cc:407] Connection header received
0807 05:00:31.428531 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:31.428533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:31.428580 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:31.428645 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:31.429040 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.429558 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.430264 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.430480 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.430551 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:31.433036 (+ 2485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:35523: BlockingRecv error: recv got EOF from 127.25.214.194:35523 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 05:00:31 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:31 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:31.632758 8669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:31.626947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:58933)
0807 05:00:31.627301 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:31.627328 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:31.627472 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:31.627771 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:31.627775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:31.628033 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:31.628226 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:31.628237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.629089 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.629094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:31.629683 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:31.629692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.630089 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.630091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:31.630153 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:31.630731 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:31.630749 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:31.632629 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":121,"threads_started":1}
W20260807 05:00:31.632903 8666 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:31.627120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:58933 (local address 127.25.214.254:43907)
0807 05:00:31.627278 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:31.627283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:31.627422 (+ 139us) server_negotiation.cc:407] Connection header received
0807 05:00:31.627574 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:31.627576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:31.627638 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:31.627730 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:31.628349 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.628966 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.629784 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:31.629999 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:31.630079 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:31.632772 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:58933: BlockingRecv error: recv got EOF from 127.25.214.195:58933 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 05:00:32 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:32 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:32.255934 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:32.250223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:46911)
0807 05:00:32.250541 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:32.250556 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:32.250653 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:32.250900 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:32.250902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:32.251095 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:32.251196 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:32.251201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.251948 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.251950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:32.252549 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:32.252557 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.253122 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.253126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:32.253212 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:32.253739 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:32.253751 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:32.255789 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":94,"threads_started":1}
W20260807 05:00:32.256153 8671 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:32.250321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46911 (local address 127.25.214.254:43907)
0807 05:00:32.250590 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:32.250594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:32.250612 (+ 18us) server_negotiation.cc:407] Connection header received
0807 05:00:32.250738 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:32.250740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:32.250788 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:32.250879 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:32.251290 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.251863 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.252683 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.252985 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.253071 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:32.255970 (+ 2899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:46911: BlockingRecv error: recv got EOF from 127.25.214.193:46911 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":89,"threads_started":1}
Aug 07 05:00:32 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:32 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:32.439119 8673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:32.433812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:54575)
0807 05:00:32.434098 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:32.434112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:32.434222 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:32.434423 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:32.434425 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:32.434603 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:32.434698 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:32.434704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.435443 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.435445 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:32.436017 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:32.436026 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.436513 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.436517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:32.436590 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:32.437107 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:32.437118 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:32.438978 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":83,"threads_started":1}
W20260807 05:00:32.439435 8671 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:32.433953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:54575 (local address 127.25.214.254:43907)
0807 05:00:32.434102 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:32.434106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:32.434177 (+ 71us) server_negotiation.cc:407] Connection header received
0807 05:00:32.434293 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:32.434295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:32.434339 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:32.434407 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:32.434782 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.435341 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.436157 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.436378 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.436453 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:32.439149 (+ 2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:54575: BlockingRecv error: recv got EOF from 127.25.214.194:54575 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 05:00:32 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:32 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:32.638971 8674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:32.633638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:39875)
0807 05:00:32.633892 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:32.633906 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:32.634011 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:32.634227 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:32.634229 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:32.634413 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:32.634511 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:32.634516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.635262 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.635264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:32.635824 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:32.635831 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.636278 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.636280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:32.636340 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:32.636895 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:32.636908 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:32.638826 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":75,"threads_started":1}
W20260807 05:00:32.639142 8671 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:32.633705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:39875 (local address 127.25.214.254:43907)
0807 05:00:32.633861 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:32.633866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:32.633970 (+ 104us) server_negotiation.cc:407] Connection header received
0807 05:00:32.634084 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:32.634086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:32.634135 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:32.634203 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:32.634639 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.635182 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.635931 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:32.636188 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:32.636270 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:32.639007 (+ 2737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:39875: BlockingRecv error: recv got EOF from 127.25.214.195:39875 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 05:00:33 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:33 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:33.264385 8675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:33.256714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:44791)
0807 05:00:33.257027 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:33.257041 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:33.257141 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:33.257362 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:33.257364 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:33.257541 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:33.257642 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:33.257647 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.258365 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.258367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:33.258934 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:33.258941 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.259324 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.259326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:33.259382 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:33.262584 (+ 3202us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:33.262596 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:33.264263 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":81,"threads_started":1}
W20260807 05:00:33.264518 8676 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:33.256766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:44791 (local address 127.25.214.254:43907)
0807 05:00:33.257078 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:33.257082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:33.257095 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:00:33.257217 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:33.257219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:33.257261 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:33.257336 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:33.257725 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.258286 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.259020 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.259247 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.259318 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:33.264396 (+ 5078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:44791: BlockingRecv error: recv got EOF from 127.25.214.193:44791 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":79,"threads_started":1}
Aug 07 05:00:33 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:33 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:33.445420 8677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:33.439997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:48127)
0807 05:00:33.440317 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:33.440330 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:33.440450 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:33.440698 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:33.440702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:33.440919 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:33.441015 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:33.441021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.441793 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.441797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:33.442378 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:33.442387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.442815 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.442819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:33.442900 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:33.443447 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:33.443460 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:33.445254 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
W20260807 05:00:33.445523 8676 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:33.440070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:48127 (local address 127.25.214.254:43907)
0807 05:00:33.440249 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:33.440254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:33.440404 (+ 150us) server_negotiation.cc:407] Connection header received
0807 05:00:33.440541 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:33.440544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:33.440592 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:33.440660 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:33.441135 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.441684 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.442493 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.442715 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.442801 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:33.445404 (+ 2603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:48127: BlockingRecv error: recv got EOF from 127.25.214.194:48127 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 05:00:33 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:33 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.195@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:33.645046 8678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:33.639824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.195:36581)
0807 05:00:33.640161 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:33.640174 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:33.640275 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:33.640495 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:33.640497 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:33.640680 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:33.640778 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:33.640783 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.641489 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.641491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:33.642053 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:33.642060 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.642438 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.642441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:33.642499 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:33.642971 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:33.642983 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:33.644876 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":109,"threads_started":1}
W20260807 05:00:33.645135 8676 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:33.639919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:36581 (local address 127.25.214.254:43907)
0807 05:00:33.640044 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:33.640048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:33.640235 (+ 187us) server_negotiation.cc:407] Connection header received
0807 05:00:33.640349 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:33.640351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:33.640398 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:33.640467 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:33.640885 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.641409 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.642136 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:33.642345 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:33.642415 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:33.645024 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.195:36581: BlockingRecv error: recv got EOF from 127.25.214.195:36581 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 05:00:34 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:34 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.193@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:34.270581 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:34.265265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.193:45083)
0807 05:00:34.265539 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:34.265552 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:34.265648 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:34.265918 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:34.265921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:34.266108 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:34.266207 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:34.266212 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.266910 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.266913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:34.267472 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:34.267480 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.267836 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.267838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:34.267894 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:34.268376 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:34.268387 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:34.270412 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":79,"threads_started":1}
W20260807 05:00:34.270689 8680 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:34.265305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45083 (local address 127.25.214.254:43907)
0807 05:00:34.265562 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:34.265565 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:34.265603 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:00:34.265720 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:34.265722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:34.265767 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:34.265841 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:34.266299 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.266830 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.267554 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.267763 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.267829 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:34.270560 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.193:45083: BlockingRecv error: recv got EOF from 127.25.214.193:45083 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":85,"threads_started":1}
Aug 07 05:00:34 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 05:00:34 dist-test-slave-lgr5 krb5kdc[7015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.214.194@KRBTEST.COM for oryx/127.25.214.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 05:00:34.451768 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:34.446294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43907 (local address 127.25.214.194:34665)
0807 05:00:34.446606 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:34.446619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:34.446729 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:34.446990 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:34.446993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:34.447232 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:34.447334 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:34.447341 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.448143 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.448147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:34.448709 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:34.448718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.449227 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.449231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:34.449312 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:34.449862 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:34.449878 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:34.451653 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.214.254:43907: Server oryx/127.25.214.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":108,"threads_started":1}
W20260807 05:00:34.451906 8680 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:34.446397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:34665 (local address 127.25.214.254:43907)
0807 05:00:34.446543 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:34.446548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:34.446687 (+ 139us) server_negotiation.cc:407] Connection header received
0807 05:00:34.446818 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:34.446821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:34.446883 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:34.446950 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:34.447472 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.448004 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.448822 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.449120 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.449211 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:34.451777 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.214.194:34665: BlockingRecv error: recv got EOF from 127.25.214.194:34665 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:00:34.541224 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 7924
I20260807 05:00:34.551728 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 8155
I20260807 05:00:34.562505 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 8365
I20260807 05:00:34.578315 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 7812
2026-08-07T05:00:34Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18184 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T05:00:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:34Z Disabled control of system clock
I20260807 05:00:34.613384 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:46587
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:46587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 05:00:34.727828 8690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:34.728235 8690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:34.728293 8690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:34.732493 8690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:34.732586 8690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:34.732604 8690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:34.732623 8690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:34.732641 8690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:34.737697 8690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:46587
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:46587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:34.738893 8690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:34.740376 8690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:34.748816 8702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:34.748875 8690 server_base.cc:1034] running on GCE node
W20260807 05:00:34.748886 8698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:34.748824 8700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:34.749596 8690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:34.750689 8690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:34.751847 8690 hybrid_clock.cc:648] HybridClock initialized: now 1786078834751821 us; error 37 us; skew 500 ppm
I20260807 05:00:34.753754 8690 webserver.cc:460] Webserver started at http://127.25.214.254:35619/ using document root <none> and password file <none>
I20260807 05:00:34.754349 8690 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:34.754434 8690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:34.754649 8690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:34.756824 8690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "87ec212ac79944b4a818d8ef79978f87"
format_stamp: "Formatted at 2026-08-07 05:00:34 on dist-test-slave-lgr5"
server_key: "1f3067b43c1a80995f1894c3937ce928"
server_key_iv: "ae7ee0756bb9f663ebfed1a241545658"
server_key_version: "encryptionkey@0"
I20260807 05:00:34.757375 8690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "87ec212ac79944b4a818d8ef79978f87"
format_stamp: "Formatted at 2026-08-07 05:00:34 on dist-test-slave-lgr5"
server_key: "1f3067b43c1a80995f1894c3937ce928"
server_key_iv: "ae7ee0756bb9f663ebfed1a241545658"
server_key_version: "encryptionkey@0"
I20260807 05:00:34.761183 8690 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 05:00:34.763648 8711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:34.764883 8690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:34.765005 8690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "87ec212ac79944b4a818d8ef79978f87"
format_stamp: "Formatted at 2026-08-07 05:00:34 on dist-test-slave-lgr5"
server_key: "1f3067b43c1a80995f1894c3937ce928"
server_key_iv: "ae7ee0756bb9f663ebfed1a241545658"
server_key_version: "encryptionkey@0"
I20260807 05:00:34.765113 8690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:34.778959 8690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:34.779752 8690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:34.779940 8690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:34.786986 8690 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:46587
I20260807 05:00:34.786999 8797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:46587 every 8 connection(s)
I20260807 05:00:34.788000 8690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:34.789611 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 8690
I20260807 05:00:34.789731 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:34.790020 26459 external_mini_cluster.cc:1428] Setting key 351a4d9e1630aab37532bee9b956c302
I20260807 05:00:34.791683 8798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:34.798436 8798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87: Bootstrap starting.
I20260807 05:00:34.799484 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:34.791353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.25.214.254:46587)
0807 05:00:34.791985 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:34.792001 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:34.792039 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:00:34.792750 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:34.792767 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:34.793172 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:34.793481 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:34.793853 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.794870 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.796049 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:34.796622 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:34.796756 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:34.797655 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:34.797660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:34.797676 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:34.798096 (+ 420us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:34.798157 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:34.798179 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:34.798256 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:34.798415 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 05:00:34.798722 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":120,"threads_started":1}
I20260807 05:00:34.801056 8798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:34.801853 8798 log.cc:824] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:34.803750 8798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87: No bootstrap required, opened a new log
I20260807 05:00:34.807403 8798 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ec212ac79944b4a818d8ef79978f87" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46587 } }
I20260807 05:00:34.807654 8798 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:34.807716 8798 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ec212ac79944b4a818d8ef79978f87, State: Initialized, Role: FOLLOWER
I20260807 05:00:34.808173 8798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ec212ac79944b4a818d8ef79978f87" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46587 } }
I20260807 05:00:34.808311 8798 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:34.808377 8798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:34.808480 8798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:34.809459 8798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ec212ac79944b4a818d8ef79978f87" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46587 } }
I20260807 05:00:34.809775 8798 leader_election.cc:302] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87ec212ac79944b4a818d8ef79978f87; no voters:
I20260807 05:00:34.810051 8798 leader_election.cc:288] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:34.810168 8810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:34.810376 8810 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [term 1 LEADER]: Becoming Leader. State: Replica: 87ec212ac79944b4a818d8ef79978f87, State: Running, Role: LEADER
I20260807 05:00:34.810707 8810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ec212ac79944b4a818d8ef79978f87" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46587 } }
I20260807 05:00:34.811234 8798 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:34.812373 8813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87ec212ac79944b4a818d8ef79978f87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ec212ac79944b4a818d8ef79978f87" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46587 } } }
I20260807 05:00:34.812373 8814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87ec212ac79944b4a818d8ef79978f87. Latest consensus state: current_term: 1 leader_uuid: "87ec212ac79944b4a818d8ef79978f87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ec212ac79944b4a818d8ef79978f87" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 46587 } } }
I20260807 05:00:34.812537 8813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:34.812537 8814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:34.813566 8822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:34.816285 8822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:34.821447 8822 catalog_manager.cc:1347] Generated new cluster ID: 0b9d8f13160447a6b96bc8809c0a7d7c
I20260807 05:00:34.821552 8822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:34.843782 8822 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:34.844838 8822 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:34.852265 8822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87ec212ac79944b4a818d8ef79978f87: Generated new TSK 0
I20260807 05:00:34.852938 8822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:00:34.863883 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46587
--builtin_ntp_servers=127.25.214.212:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 05:00:34.981047 8834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:34.981325 8834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:34.981364 8834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:34.985445 8834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:34.985512 8834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:34.985569 8834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:34.990368 8834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:34.991508 8834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:34.992919 8834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:35.002741 8843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.002734 8841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.002733 8845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:35.003079 8834 server_base.cc:1034] running on GCE node
I20260807 05:00:35.003515 8834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:35.004321 8834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:35.005503 8834 hybrid_clock.cc:648] HybridClock initialized: now 1786078835005473 us; error 42 us; skew 500 ppm
I20260807 05:00:35.007473 8834 webserver.cc:460] Webserver started at http://127.25.214.193:38381/ using document root <none> and password file <none>
I20260807 05:00:35.008068 8834 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:35.008175 8834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:35.008394 8834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:35.010471 8834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "68791b40f3b7452193767ad2b7f1bdea"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "42466a844eae61248f70e1ed7ea2cd89"
server_key_iv: "823ab105c63d339a69b76956aefdf439"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.011019 8834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "68791b40f3b7452193767ad2b7f1bdea"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "42466a844eae61248f70e1ed7ea2cd89"
server_key_iv: "823ab105c63d339a69b76956aefdf439"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.015012 8834 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 05:00:35.017624 8855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.018846 8834 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:35.018983 8834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "68791b40f3b7452193767ad2b7f1bdea"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "42466a844eae61248f70e1ed7ea2cd89"
server_key_iv: "823ab105c63d339a69b76956aefdf439"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.019089 8834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:35.029560 8834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:35.030283 8834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:35.030465 8834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:35.031078 8834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:35.032060 8834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:35.032150 8834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.032207 8834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:35.032234 8834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.040787 8834 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:43195
I20260807 05:00:35.040832 9038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:43195 every 8 connection(s)
I20260807 05:00:35.041785 8834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:35.051143 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.043757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:55325 (local address 127.25.214.254:46587)
0807 05:00:35.043889 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:35.043893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:35.045118 (+ 1225us) server_negotiation.cc:407] Connection header received
0807 05:00:35.046583 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:35.046587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:35.046646 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:35.046738 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:35.047680 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.048241 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.049437 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.049659 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.049734 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:35.050738 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:35.050741 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:35.050743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:35.050757 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:35.050777 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:35.050785 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:35.050837 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:35.050947 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 05:00:35.051008 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:00:35.052119 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 8834
I20260807 05:00:35.052115 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.044195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:46587 (local address 127.25.214.193:55325)
0807 05:00:35.044946 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:35.044993 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:35.046320 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:35.046905 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:35.046911 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:35.046998 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:35.047540 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:35.047554 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.048387 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.048390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:35.049320 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:35.049331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.049780 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.049782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:35.049925 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:35.050479 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:35.050480 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:35.050528 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:35.050598 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:35.050842 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:35.050847 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:35.050851 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 05:00:35.050938 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 05:00:35.051172 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":149,"threads_started":1}
I20260807 05:00:35.052225 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:35.052525 26459 external_mini_cluster.cc:1428] Setting key 686c40ae64844b0ea55acbc75488e7a3
I20260807 05:00:35.053498 9039 heartbeater.cc:347] Connected to a master server at 127.25.214.254:46587
I20260807 05:00:35.053757 9039 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:35.054380 9039 heartbeater.cc:511] Master 127.25.214.254:46587 requested a full tablet report, sending...
I20260807 05:00:35.054559 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46587
--builtin_ntp_servers=127.25.214.212:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 05:00:35.056030 8741 ts_manager.cc:194] Registered new tserver with Master: 68791b40f3b7452193767ad2b7f1bdea (127.25.214.193:43195)
I20260807 05:00:35.057623 8741 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.193:55325
W20260807 05:00:35.168045 9042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:35.168428 9042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:35.168474 9042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:35.172679 9042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:35.172739 9042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:35.172801 9042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:35.177625 9042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:35.178753 9042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:35.180205 9042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:35.190403 9050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.190421 9055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.190402 9051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:35.190462 9042 server_base.cc:1034] running on GCE node
I20260807 05:00:35.191061 9042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:35.191709 9042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:35.192862 9042 hybrid_clock.cc:648] HybridClock initialized: now 1786078835192828 us; error 44 us; skew 500 ppm
I20260807 05:00:35.194782 9042 webserver.cc:460] Webserver started at http://127.25.214.194:33579/ using document root <none> and password file <none>
I20260807 05:00:35.195354 9042 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:35.195416 9042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:35.195617 9042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:35.197742 9042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "88a55f4b0e7840c6b71258ad0c95db64"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "edd5afe543d498b30e3a54fb856c7c31"
server_key_iv: "4d790abb0722a9ebdcdddf77a707eaa7"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.198264 9042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "88a55f4b0e7840c6b71258ad0c95db64"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "edd5afe543d498b30e3a54fb856c7c31"
server_key_iv: "4d790abb0722a9ebdcdddf77a707eaa7"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.202111 9042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:00:35.204810 9065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.206058 9042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:35.206187 9042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "88a55f4b0e7840c6b71258ad0c95db64"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "edd5afe543d498b30e3a54fb856c7c31"
server_key_iv: "4d790abb0722a9ebdcdddf77a707eaa7"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.206295 9042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:35.225692 9042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:35.226449 9042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:35.226651 9042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:35.227291 9042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:35.228385 9042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:35.228438 9042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.228495 9042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:35.228529 9042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.237637 9042 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:46677
I20260807 05:00:35.237673 9249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:46677 every 8 connection(s)
I20260807 05:00:35.238576 9042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:35.243126 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 9042
I20260807 05:00:35.243237 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:35.243523 26459 external_mini_cluster.cc:1428] Setting key c7ff85cf69feb29924107ed1af46561b
I20260807 05:00:35.245484 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46587
--builtin_ntp_servers=127.25.214.212:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 05:00:35.247750 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.240440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:60719 (local address 127.25.214.254:46587)
0807 05:00:35.240582 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:35.240586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:35.241677 (+ 1091us) server_negotiation.cc:407] Connection header received
0807 05:00:35.243055 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:35.243059 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:35.243119 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:35.243194 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:35.244154 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.244687 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.245867 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.246100 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.246189 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:35.247313 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:35.247316 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:35.247318 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:35.247331 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:35.247354 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:35.247362 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:35.247423 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:35.247579 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 05:00:35.247631 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:00:35.248891 9252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.240856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:46587 (local address 127.25.214.194:60719)
0807 05:00:35.241503 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:35.241562 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:35.242838 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:35.243390 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:35.243398 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:35.243478 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:35.243989 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:35.244002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.244794 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.244798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:35.245750 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:35.245761 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.246242 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.246246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:35.246402 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:35.246995 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:35.246997 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:35.247057 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:35.247149 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:35.247436 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:35.247444 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:35.247450 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:00:35.247576 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 05:00:35.247887 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":114,"threads_started":1}
I20260807 05:00:35.249990 9250 heartbeater.cc:347] Connected to a master server at 127.25.214.254:46587
I20260807 05:00:35.250241 9250 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:35.250783 9250 heartbeater.cc:511] Master 127.25.214.254:46587 requested a full tablet report, sending...
I20260807 05:00:35.251823 8741 ts_manager.cc:194] Registered new tserver with Master: 88a55f4b0e7840c6b71258ad0c95db64 (127.25.214.194:46677)
I20260807 05:00:35.252432 8741 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.194:60719
W20260807 05:00:35.366171 9253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:35.366518 9253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:35.366559 9253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:35.370905 9253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:35.370985 9253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:35.371042 9253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:35.376472 9253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:35.377713 9253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:35.379235 9253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:35.390095 9270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.390096 9266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.390096 9265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:35.390233 9253 server_base.cc:1034] running on GCE node
I20260807 05:00:35.390944 9253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:35.391759 9253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:35.392937 9253 hybrid_clock.cc:648] HybridClock initialized: now 1786078835392907 us; error 53 us; skew 500 ppm
I20260807 05:00:35.395037 9253 webserver.cc:460] Webserver started at http://127.25.214.195:42069/ using document root <none> and password file <none>
I20260807 05:00:35.395689 9253 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:35.395766 9253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:35.396004 9253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:35.398264 9253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "ead364511d0b4df6b2e951497bfe0d25"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "26fc380949406dfa127fe2a7163b704c"
server_key_iv: "52e431370f04ad050ae65a535bf01b1e"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.398836 9253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "ead364511d0b4df6b2e951497bfe0d25"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "26fc380949406dfa127fe2a7163b704c"
server_key_iv: "52e431370f04ad050ae65a535bf01b1e"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.402740 9253 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 05:00:35.405362 9282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.406589 9253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:35.406704 9253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "ead364511d0b4df6b2e951497bfe0d25"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "26fc380949406dfa127fe2a7163b704c"
server_key_iv: "52e431370f04ad050ae65a535bf01b1e"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.406809 9253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:35.427579 9253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:35.428418 9253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:35.428608 9253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:35.429242 9253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:35.430262 9253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:35.430313 9253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.430369 9253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:35.430400 9253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.439779 9253 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:35307
I20260807 05:00:35.439844 9445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:35307 every 8 connection(s)
I20260807 05:00:35.440820 9253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:35.443560 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 9253
I20260807 05:00:35.443681 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:35.443969 26459 external_mini_cluster.cc:1428] Setting key 0cd61223636a47d03855c88d3c115a66
I20260807 05:00:35.451148 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.442923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:51999 (local address 127.25.214.254:46587)
0807 05:00:35.443101 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:35.443105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:35.444370 (+ 1265us) server_negotiation.cc:407] Connection header received
0807 05:00:35.446030 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:35.446034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:35.446112 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:35.446210 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:35.447270 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.447818 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.449211 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.449458 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.449537 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:35.450727 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:35.450730 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:35.450732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:35.450749 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:35.450769 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:35.450777 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:35.450833 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:35.450957 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 05:00:35.451017 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 05:00:35.452565 9455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.443328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:46587 (local address 127.25.214.195:51999)
0807 05:00:35.444176 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:35.444234 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:35.445775 (+ 1541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:35.446402 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:35.446410 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:35.446511 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:35.447099 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:35.447114 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.447989 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.447992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:35.449079 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:35.449092 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:35.449636 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:35.449640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:35.449815 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:35.450446 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:35.450448 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:35.450495 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:35.450576 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:35.450846 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:35.450851 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:35.450855 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 05:00:35.450952 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 05:00:35.451231 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":131,"threads_started":1}
I20260807 05:00:35.453927 9447 heartbeater.cc:347] Connected to a master server at 127.25.214.254:46587
I20260807 05:00:35.454183 9447 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:35.454782 9447 heartbeater.cc:511] Master 127.25.214.254:46587 requested a full tablet report, sending...
I20260807 05:00:35.455947 8741 ts_manager.cc:194] Registered new tserver with Master: ead364511d0b4df6b2e951497bfe0d25 (127.25.214.195:35307)
I20260807 05:00:35.456612 8741 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.195:51999
I20260807 05:00:35.458381 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 05:00:35.461809 8808 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:35.460742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47698 (local address 127.25.214.254:46587)
0807 05:00:35.460884 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:35.460889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:35.461053 (+ 164us) server_negotiation.cc:407] Connection header received
0807 05:00:35.461247 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:35.461250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:35.461314 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:35.461396 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:35.461654 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47698: BlockingRecv error: recv got EOF from 127.0.0.1:47698 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 05:00:35.462175 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 8834
I20260807 05:00:35.489120 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 9042
I20260807 05:00:35.498103 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 9253
I20260807 05:00:35.527513 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 8690
2026-08-07T05:00:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (952 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T05:00:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:35Z Disabled control of system clock
I20260807 05:00:35.565369 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36625
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 05:00:35.678544 9468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:35.678839 9468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:35.678879 9468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:35.682966 9468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:35.683049 9468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:35.683064 9468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:35.683080 9468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:35.683095 9468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:35.688249 9468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36625
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:35.689493 9468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:35.690994 9468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:35.699376 9483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.699388 9477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.699388 9478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:35.699501 9468 server_base.cc:1034] running on GCE node
I20260807 05:00:35.700296 9468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:35.701494 9468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:35.702647 9468 hybrid_clock.cc:648] HybridClock initialized: now 1786078835702623 us; error 49 us; skew 500 ppm
I20260807 05:00:35.704605 9468 webserver.cc:460] Webserver started at http://127.25.214.254:38385/ using document root <none> and password file <none>
I20260807 05:00:35.705195 9468 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:35.705260 9468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:35.705461 9468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:35.707566 9468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "f3f72daaf04f4426b44eb1650d4df4a9"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "28616e4f7ca1b44c4358d5607fef792b"
server_key_iv: "be2aa5ccadc7fed441a8f1a65c53436b"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.708170 9468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "f3f72daaf04f4426b44eb1650d4df4a9"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "28616e4f7ca1b44c4358d5607fef792b"
server_key_iv: "be2aa5ccadc7fed441a8f1a65c53436b"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.711992 9468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:00:35.714527 9493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.715768 9468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:00:35.715909 9468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "f3f72daaf04f4426b44eb1650d4df4a9"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "28616e4f7ca1b44c4358d5607fef792b"
server_key_iv: "be2aa5ccadc7fed441a8f1a65c53436b"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.716019 9468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:35.720775 9468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:35.721450 9468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:35.721627 9468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:35.728758 9468 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:36625
I20260807 05:00:35.728775 9566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:36625 every 8 connection(s)
I20260807 05:00:35.730050 9468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:35.731413 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 9468
I20260807 05:00:35.731530 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:35.731808 26459 external_mini_cluster.cc:1428] Setting key 024b4465568b9e666972ff4a55c55301
I20260807 05:00:35.734247 9568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:35.737963 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.733368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42634 (local address 127.25.214.254:36625)
0807 05:00:35.734185 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:35.734201 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:35.734242 (+ 41us) server_negotiation.cc:407] Connection header received
0807 05:00:35.734954 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:35.734974 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:35.735374 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:35.735729 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:35.736606 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:35.736611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:35.736624 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:35.736635 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:35.736697 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:35.736714 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:35.736865 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:35.736939 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 05:00:35.737192 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":207,"threads_started":1}
I20260807 05:00:35.741024 9568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9: Bootstrap starting.
I20260807 05:00:35.743577 9568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:35.744401 9568 log.cc:824] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:35.746536 9568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9: No bootstrap required, opened a new log
I20260807 05:00:35.750494 9568 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36625 } }
I20260807 05:00:35.750799 9568 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:35.750855 9568 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3f72daaf04f4426b44eb1650d4df4a9, State: Initialized, Role: FOLLOWER
I20260807 05:00:35.751327 9568 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36625 } }
I20260807 05:00:35.751495 9568 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:35.751575 9568 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:35.751684 9568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:35.752839 9568 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36625 } }
I20260807 05:00:35.753237 9568 leader_election.cc:302] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3f72daaf04f4426b44eb1650d4df4a9; no voters:
I20260807 05:00:35.753635 9568 leader_election.cc:288] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:35.753789 9575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:35.754060 9575 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [term 1 LEADER]: Becoming Leader. State: Replica: f3f72daaf04f4426b44eb1650d4df4a9, State: Running, Role: LEADER
I20260807 05:00:35.754434 9575 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36625 } }
I20260807 05:00:35.755134 9568 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:35.756219 9576 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36625 } } }
I20260807 05:00:35.756361 9576 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:35.756625 9577 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3f72daaf04f4426b44eb1650d4df4a9. Latest consensus state: current_term: 1 leader_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f72daaf04f4426b44eb1650d4df4a9" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36625 } } }
I20260807 05:00:35.756707 9577 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:35.757052 9589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:35.759830 9589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:35.765605 9589 catalog_manager.cc:1347] Generated new cluster ID: b1ace9b63e6b439d9703e26649e2bc67
I20260807 05:00:35.765705 9589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:35.774979 9589 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:35.775336 9589 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:35.784757 9589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3f72daaf04f4426b44eb1650d4df4a9: Generated new TSK 0
I20260807 05:00:35.785488 9589 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:00:35.793848 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36625
--builtin_ntp_servers=127.25.214.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 05:00:35.912506 9607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:35.912808 9607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:35.912863 9607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:35.916994 9607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:35.917058 9607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:35.917119 9607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:35.922127 9607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:35.923242 9607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:35.924958 9607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:35.935002 9621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:35.935075 9607 server_base.cc:1034] running on GCE node
W20260807 05:00:35.935019 9619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:35.935015 9616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:35.935585 9607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:35.936292 9607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:35.937448 9607 hybrid_clock.cc:648] HybridClock initialized: now 1786078835937421 us; error 38 us; skew 500 ppm
I20260807 05:00:35.939361 9607 webserver.cc:460] Webserver started at http://127.25.214.193:45643/ using document root <none> and password file <none>
I20260807 05:00:35.939975 9607 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:35.940047 9607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:35.940335 9607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:35.943015 9607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "0dcfe87b1ea8427699caf7655adac795"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "ab63c38e7aa822003e4df655138fa084"
server_key_iv: "0a5c2e27019845ab819c4a5b71dc7952"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.943579 9607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "0dcfe87b1ea8427699caf7655adac795"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "ab63c38e7aa822003e4df655138fa084"
server_key_iv: "0a5c2e27019845ab819c4a5b71dc7952"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.947448 9607 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 05:00:35.950199 9631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.951478 9607 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 05:00:35.951591 9607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "0dcfe87b1ea8427699caf7655adac795"
format_stamp: "Formatted at 2026-08-07 05:00:35 on dist-test-slave-lgr5"
server_key: "ab63c38e7aa822003e4df655138fa084"
server_key_iv: "0a5c2e27019845ab819c4a5b71dc7952"
server_key_version: "encryptionkey@0"
I20260807 05:00:35.951706 9607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:35.956681 9607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:35.957404 9607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:35.957583 9607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:35.958176 9607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:35.959192 9607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:35.959239 9607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.959283 9607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:35.959311 9607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:35.967923 9607 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:41805
I20260807 05:00:35.967945 9800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:41805 every 8 connection(s)
I20260807 05:00:35.968879 9607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:35.971565 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 9607
I20260807 05:00:35.971688 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:35.972020 26459 external_mini_cluster.cc:1428] Setting key 8149e9a45082082a1467dc7f39a58aae
I20260807 05:00:35.974625 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36625
--builtin_ntp_servers=127.25.214.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 05:00:35.976347 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.970666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:33967 (local address 127.25.214.254:36625)
0807 05:00:35.970821 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:35.970826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:35.972440 (+ 1614us) server_negotiation.cc:407] Connection header received
0807 05:00:35.974052 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:35.974055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:35.974096 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:35.974142 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:35.975725 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:35.975752 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:35.975755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:35.975769 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:35.975790 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:35.975801 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:35.975864 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:35.976166 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 05:00:35.976212 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:00:35.977897 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:35.971089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36625 (local address 127.25.214.193:33967)
0807 05:00:35.972243 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:35.972302 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:35.973806 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:35.974516 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:35.974535 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:35.974649 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:35.975320 (+ 671us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:35.975322 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:35.975405 (+ 83us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:35.975520 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:35.975946 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:35.975954 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:35.975959 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 05:00:35.976643 (+ 684us) client_negotiation.cc:240] Negotiation successful
0807 05:00:35.976909 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":169,"threads_started":1}
I20260807 05:00:35.979151 9802 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36625
I20260807 05:00:35.979441 9802 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:35.979915 9802 heartbeater.cc:511] Master 127.25.214.254:36625 requested a full tablet report, sending...
I20260807 05:00:35.981642 9517 ts_manager.cc:194] Registered new tserver with Master: 0dcfe87b1ea8427699caf7655adac795 (127.25.214.193:41805)
W20260807 05:00:36.099179 9810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:36.099462 9810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:36.099511 9810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:36.103752 9810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:36.103845 9810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:36.103905 9810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:36.108919 9810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:36.110185 9810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:36.111709 9810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:36.121850 9818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:36.122037 9810 server_base.cc:1034] running on GCE node
W20260807 05:00:36.121852 9822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:36.121852 9820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:36.122649 9810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:36.123286 9810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:36.124437 9810 hybrid_clock.cc:648] HybridClock initialized: now 1786078836124422 us; error 32 us; skew 500 ppm
I20260807 05:00:36.126322 9810 webserver.cc:460] Webserver started at http://127.25.214.194:39643/ using document root <none> and password file <none>
I20260807 05:00:36.126894 9810 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:36.126958 9810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:36.127135 9810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:36.129539 9810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "85c40b2c157349a7bbfb711789009571"
format_stamp: "Formatted at 2026-08-07 05:00:36 on dist-test-slave-lgr5"
server_key: "9689061e0235aa48017d1ae66993916d"
server_key_iv: "8806c670dfe9dec93dc1bfda1ddc2215"
server_key_version: "encryptionkey@0"
I20260807 05:00:36.130169 9810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "85c40b2c157349a7bbfb711789009571"
format_stamp: "Formatted at 2026-08-07 05:00:36 on dist-test-slave-lgr5"
server_key: "9689061e0235aa48017d1ae66993916d"
server_key_iv: "8806c670dfe9dec93dc1bfda1ddc2215"
server_key_version: "encryptionkey@0"
I20260807 05:00:36.135497 9810 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 05:00:36.142670 9831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:36.144356 9810 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.003s
I20260807 05:00:36.144502 9810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "85c40b2c157349a7bbfb711789009571"
format_stamp: "Formatted at 2026-08-07 05:00:36 on dist-test-slave-lgr5"
server_key: "9689061e0235aa48017d1ae66993916d"
server_key_iv: "8806c670dfe9dec93dc1bfda1ddc2215"
server_key_version: "encryptionkey@0"
I20260807 05:00:36.144634 9810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:36.149406 9810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:36.150035 9810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:36.150182 9810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:36.150702 9810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:36.151619 9810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:36.151666 9810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:36.151705 9810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:36.151724 9810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:36.160825 9810 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:44041
I20260807 05:00:36.160869 10006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:44041 every 8 connection(s)
I20260807 05:00:36.161850 9810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:36.162890 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 9810
I20260807 05:00:36.163010 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:36.163303 26459 external_mini_cluster.cc:1428] Setting key bca32c34281f80622b5730cc43b9bb47
I20260807 05:00:36.165485 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36625
--builtin_ntp_servers=127.25.214.212:44265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 05:00:36.169023 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:36.163998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:59877 (local address 127.25.214.254:36625)
0807 05:00:36.164194 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:36.164199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:36.165531 (+ 1332us) server_negotiation.cc:407] Connection header received
0807 05:00:36.166959 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:36.166962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:36.167013 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:36.167104 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:36.168512 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:36.168515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:36.168517 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:36.168533 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:36.168557 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:36.168566 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:36.168667 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:36.168824 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 05:00:36.168875 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 05:00:36.169965 10010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:36.164502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36625 (local address 127.25.214.194:59877)
0807 05:00:36.165350 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:36.165408 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:36.166724 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:36.167341 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:36.167351 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:36.167476 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:36.168162 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:36.168164 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:36.168224 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:36.168328 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:36.168664 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:36.168677 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:36.168683 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:00:36.168867 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 05:00:36.169146 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":152,"threads_started":1}
I20260807 05:00:36.171233 10007 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36625
I20260807 05:00:36.171465 10007 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:36.171900 10007 heartbeater.cc:511] Master 127.25.214.254:36625 requested a full tablet report, sending...
I20260807 05:00:36.173020 9517 ts_manager.cc:194] Registered new tserver with Master: 85c40b2c157349a7bbfb711789009571 (127.25.214.194:44041)
W20260807 05:00:36.281252 10012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:36.281561 10012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:36.281617 10012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:36.285646 10012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:36.285718 10012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:36.285800 10012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:36.290827 10012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:36.292006 10012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:36.293462 10012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:36.303256 10023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:36.303274 10021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:36.303284 10020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:36.303771 10012 server_base.cc:1034] running on GCE node
I20260807 05:00:36.304279 10012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:36.305028 10012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:36.306234 10012 hybrid_clock.cc:648] HybridClock initialized: now 1786078836306194 us; error 58 us; skew 500 ppm
I20260807 05:00:36.308418 10012 webserver.cc:460] Webserver started at http://127.25.214.195:34667/ using document root <none> and password file <none>
I20260807 05:00:36.309051 10012 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:36.309124 10012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:36.309333 10012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:36.311542 10012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "265846539b394a0b9ca57c5008fb9dd4"
format_stamp: "Formatted at 2026-08-07 05:00:36 on dist-test-slave-lgr5"
server_key: "92bbd910aa8a27b77ec8641d0a49b32d"
server_key_iv: "e2170d59f2a0e045f9b213ad4fa1f99c"
server_key_version: "encryptionkey@0"
I20260807 05:00:36.312206 10012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "265846539b394a0b9ca57c5008fb9dd4"
format_stamp: "Formatted at 2026-08-07 05:00:36 on dist-test-slave-lgr5"
server_key: "92bbd910aa8a27b77ec8641d0a49b32d"
server_key_iv: "e2170d59f2a0e045f9b213ad4fa1f99c"
server_key_version: "encryptionkey@0"
I20260807 05:00:36.316489 10012 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:00:36.319423 10032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:36.320886 10012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:00:36.321035 10012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "265846539b394a0b9ca57c5008fb9dd4"
format_stamp: "Formatted at 2026-08-07 05:00:36 on dist-test-slave-lgr5"
server_key: "92bbd910aa8a27b77ec8641d0a49b32d"
server_key_iv: "e2170d59f2a0e045f9b213ad4fa1f99c"
server_key_version: "encryptionkey@0"
I20260807 05:00:36.321162 10012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:36.326655 10012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:36.327430 10012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:36.327625 10012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:36.328317 10012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:36.329376 10012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:36.329427 10012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:36.329484 10012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:36.329511 10012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:36.338395 10012 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:39011
I20260807 05:00:36.338423 10198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:39011 every 8 connection(s)
I20260807 05:00:36.339395 10012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:36.343107 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 10012
I20260807 05:00:36.343233 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:36.343528 26459 external_mini_cluster.cc:1428] Setting key b891f33a80a00d9d54e24e3720639907
I20260807 05:00:36.346534 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:36.341654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:47965 (local address 127.25.214.254:36625)
0807 05:00:36.341811 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:36.341815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:36.343077 (+ 1262us) server_negotiation.cc:407] Connection header received
0807 05:00:36.344692 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:36.344696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:36.344748 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:36.344825 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:36.346125 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:36.346128 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:36.346130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:00:36.346143 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:36.346164 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:00:36.346172 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:36.346247 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:36.346343 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 05:00:36.346419 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 05:00:36.347604 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:36.342072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36625 (local address 127.25.214.195:47965)
0807 05:00:36.342894 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:36.342942 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:36.344412 (+ 1470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:36.345075 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:36.345084 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:36.345198 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:36.345807 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:00:36.345809 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:36.345872 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:00:36.345987 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:36.346242 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:36.346246 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:36.346250 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 05:00:36.346385 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 05:00:36.346619 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":183,"threads_started":1}
I20260807 05:00:36.348869 10200 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36625
I20260807 05:00:36.349134 10200 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:36.349640 10200 heartbeater.cc:511] Master 127.25.214.254:36625 requested a full tablet report, sending...
I20260807 05:00:36.350817 9517 ts_manager.cc:194] Registered new tserver with Master: 265846539b394a0b9ca57c5008fb9dd4 (127.25.214.195:39011)
I20260807 05:00:36.357983 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 05:00:36.360870 9573 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:00:36.359957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42646 (local address 127.25.214.254:36625)
0807 05:00:36.360155 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:36.360160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:36.360300 (+ 140us) server_negotiation.cc:407] Connection header received
0807 05:00:36.360428 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:36.360430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:36.360466 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:36.360535 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:36.360729 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42646: BlockingRecv error: recv got EOF from 127.0.0.1:42646 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:00:36.361213 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 9607
I20260807 05:00:36.374933 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 9810
I20260807 05:00:36.400641 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 10012
I20260807 05:00:36.408968 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 9468
2026-08-07T05:00:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (881 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:36 dist-test-slave-lgr5 krb5kdc[10214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:36 dist-test-slave-lgr5 krb5kdc[10214](info): set up 2 sockets
Aug 07 05:00:36 dist-test-slave-lgr5 krb5kdc[10214](info): commencing operation
krb5kdc: starting...
W20260807 05:00:37.569329 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:37 dist-test-slave-lgr5 krb5kdc[10214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:00:37.692487 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:35285
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:35285
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:37.805308 10228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:37.805583 10228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:37.805641 10228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:37.809598 10228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:00:37.809655 10228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:37.809681 10228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:37.809703 10228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:00:37.809732 10228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:00:37.814977 10228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:35285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:35285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:37.816046 10228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:37.817082 10228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:37.825621 10234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:37.825601 10239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:37.825601 10233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:37.825652 10228 server_base.cc:1034] running on GCE node
I20260807 05:00:37.826356 10228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:37.827386 10228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:37.828545 10228 hybrid_clock.cc:648] HybridClock initialized: now 1786078837828528 us; error 36 us; skew 500 ppm
Aug 07 05:00:37 dist-test-slave-lgr5 krb5kdc[10214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078837, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:37.831149 10228 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:00:37.832064 10228 webserver.cc:460] Webserver started at http://127.25.214.254:37315/ using document root <none> and password file <none>
I20260807 05:00:37.832623 10228 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:37.832681 10228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:37.832846 10228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:37.834836 10228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "de4afb1186e8454ca5408a7b3e22d4a0"
format_stamp: "Formatted at 2026-08-07 05:00:37 on dist-test-slave-lgr5"
server_key: "c3dfb2ca9c35846f5cf6ad8d1fe7528b"
server_key_iv: "394414f38403e53a42ac5c7df341aea3"
server_key_version: "encryptionkey@0"
I20260807 05:00:37.835356 10228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "de4afb1186e8454ca5408a7b3e22d4a0"
format_stamp: "Formatted at 2026-08-07 05:00:37 on dist-test-slave-lgr5"
server_key: "c3dfb2ca9c35846f5cf6ad8d1fe7528b"
server_key_iv: "394414f38403e53a42ac5c7df341aea3"
server_key_version: "encryptionkey@0"
I20260807 05:00:37.838981 10228 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 05:00:37.841323 10254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:37.842641 10228 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:37.842769 10228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "de4afb1186e8454ca5408a7b3e22d4a0"
format_stamp: "Formatted at 2026-08-07 05:00:37 on dist-test-slave-lgr5"
server_key: "c3dfb2ca9c35846f5cf6ad8d1fe7528b"
server_key_iv: "394414f38403e53a42ac5c7df341aea3"
server_key_version: "encryptionkey@0"
I20260807 05:00:37.842871 10228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:37.861560 10228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:37.864339 10228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:37.864493 10228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:37.871088 10228 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:35285
I20260807 05:00:37.871330 10331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:35285 every 8 connection(s)
I20260807 05:00:37.872066 10228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:00:37.875051 10333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:37.880051 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 10228
I20260807 05:00:37.880220 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:00:37.880532 26459 external_mini_cluster.cc:1428] Setting key e9f598e0b61fae4576dc87a735cd78a1
I20260807 05:00:37.882148 10333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0: Bootstrap starting.
I20260807 05:00:37.884483 10333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:37.885248 10333 log.cc:824] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:37.887143 10333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0: No bootstrap required, opened a new log
Aug 07 05:00:37 dist-test-slave-lgr5 krb5kdc[10214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:37.890656 10333 raft_consensus.cc:348] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35285 } }
I20260807 05:00:37.890883 10333 raft_consensus.cc:374] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:37.890954 10333 raft_consensus.cc:729] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4afb1186e8454ca5408a7b3e22d4a0, State: Initialized, Role: FOLLOWER
I20260807 05:00:37.891355 10333 consensus_queue.cc:260] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35285 } }
I20260807 05:00:37.891482 10333 raft_consensus.cc:388] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:00:37.891556 10333 raft_consensus.cc:482] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:00:37.891651 10333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:37.892544 10333 raft_consensus.cc:504] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35285 } }
I20260807 05:00:37.892864 10333 leader_election.cc:302] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de4afb1186e8454ca5408a7b3e22d4a0; no voters:
I20260807 05:00:37.893165 10333 leader_election.cc:288] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:00:37.893335 10341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:37.893527 10341 raft_consensus.cc:686] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [term 1 LEADER]: Becoming Leader. State: Replica: de4afb1186e8454ca5408a7b3e22d4a0, State: Running, Role: LEADER
I20260807 05:00:37.893824 10341 consensus_queue.cc:237] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35285 } }
I20260807 05:00:37.894229 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:37.881963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47066 (local address 127.25.214.254:35285)
0807 05:00:37.882491 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:37.882508 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:37.882544 (+ 36us) server_negotiation.cc:407] Connection header received
0807 05:00:37.883192 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:37.883210 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:37.883588 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:37.883892 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:37.884754 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:37.885802 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:37.886631 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:37.887105 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:37.887251 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:37.889600 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:37.889605 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:37.889619 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:37.889646 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:37.891262 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:37.891668 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:37.891674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:37.891680 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:37.891822 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:37.892098 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:37.892102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:37.892104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:37.892505 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:37.892685 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:37.892963 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 05:00:37.893291 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":145,"threads_started":1}
I20260807 05:00:37.894456 10333 sys_catalog.cc:564] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:00:37.895498 10343 sys_catalog.cc:455] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de4afb1186e8454ca5408a7b3e22d4a0. Latest consensus state: current_term: 1 leader_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35285 } } }
I20260807 05:00:37.895625 10343 sys_catalog.cc:458] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:37.895972 10342 sys_catalog.cc:455] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4afb1186e8454ca5408a7b3e22d4a0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 35285 } } }
I20260807 05:00:37.896061 10342 sys_catalog.cc:458] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0 [sys.catalog]: This master's current role is: LEADER
I20260807 05:00:37.896443 10350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:00:37.899185 10350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:00:37.905207 10350 catalog_manager.cc:1347] Generated new cluster ID: 916f411a9b0e4ad48c5f23d118f4a968
I20260807 05:00:37.905277 10350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:00:37.919546 10350 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:00:37.921623 10350 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:00:37.931720 10350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0: Generated new TSK 0
I20260807 05:00:37.932451 10350 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:00:37.969069 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35285
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:38.111912 10364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:38.112226 10364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:38.112290 10364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:38.116351 10364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:38.116428 10364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:38.116520 10364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:00:38.122118 10364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:38.123311 10364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:38.124421 10364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:38.134050 10372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:38.134050 10371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:38.134109 10374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:38.134531 10364 server_base.cc:1034] running on GCE node
I20260807 05:00:38.134965 10364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:38.135673 10364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:38.136873 10364 hybrid_clock.cc:648] HybridClock initialized: now 1786078838136851 us; error 35 us; skew 500 ppm
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[10214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078838, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:38.140235 10364 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:00:38.141275 10364 webserver.cc:460] Webserver started at http://127.25.214.193:33095/ using document root <none> and password file <none>
I20260807 05:00:38.141875 10364 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:38.141944 10364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:38.142166 10364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:38.144366 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "ae7d1db15a6849f0a3d296daa0265d40"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "612d9efe67f803567519624159870b98"
server_key_iv: "509b49766f4122daf0e77bfe38f157ff"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.144915 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "ae7d1db15a6849f0a3d296daa0265d40"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "612d9efe67f803567519624159870b98"
server_key_iv: "509b49766f4122daf0e77bfe38f157ff"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.148736 10364 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:00:38.151086 10383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.152295 10364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:00:38.152426 10364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "ae7d1db15a6849f0a3d296daa0265d40"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "612d9efe67f803567519624159870b98"
server_key_iv: "509b49766f4122daf0e77bfe38f157ff"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.152520 10364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:38.165762 10364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:38.168834 10364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:38.169019 10364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:38.169600 10364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:38.170423 10364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:38.170467 10364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.170508 10364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:38.170537 10364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.179612 10364 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:46281
I20260807 05:00:38.179630 10553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:46281 every 8 connection(s)
I20260807 05:00:38.180651 10364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:00:38.187613 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 10364
I20260807 05:00:38.187736 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:00:38.188061 26459 external_mini_cluster.cc:1428] Setting key 4b07b4d44dd2297c5f33486b73ad21b2
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[10214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078838, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:38.194630 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.182514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:57151 (local address 127.25.214.254:35285)
0807 05:00:38.182676 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.182681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.183537 (+ 856us) server_negotiation.cc:407] Connection header received
0807 05:00:38.184909 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.184912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.184963 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.185039 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:38.186220 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.186778 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.188242 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.188481 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.188567 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.191023 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:38.191027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:38.191030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:38.191059 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:38.192475 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.193007 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.193010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.193011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.193089 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.193443 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.193445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.193446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.193616 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:38.193685 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.194393 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.194505 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:00:38.195921 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.182900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35285 (local address 127.25.214.193:57151)
0807 05:00:38.183388 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.183431 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.184703 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.185208 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.185215 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.185577 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:38.186067 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.186080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.186908 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.186911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.188124 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.188136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.188639 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.188645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.188847 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.189455 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:38.189471 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:38.190863 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:38.192583 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:38.192589 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:38.192604 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:38.192921 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:38.193169 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:38.193172 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:38.193174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:38.193348 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:38.193721 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:38.193728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:38.194129 (+ 401us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.194366 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.194722 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":130,"threads_started":1}
I20260807 05:00:38.197255 10554 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35285
I20260807 05:00:38.197491 10554 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:38.197984 10554 heartbeater.cc:511] Master 127.25.214.254:35285 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:00:38.199476 10277 ts_manager.cc:194] Registered new tserver with Master: ae7d1db15a6849f0a3d296daa0265d40 (127.25.214.193:46281)
I20260807 05:00:38.200627 10277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:57151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:00:38.216327 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35285
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:38.330727 10559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:38.330993 10559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:38.331051 10559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:38.335111 10559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:38.335188 10559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:38.335273 10559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:00:38.340816 10559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:38.341991 10559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:38.343029 10559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:38.352696 10569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:38.352716 10559 server_base.cc:1034] running on GCE node
W20260807 05:00:38.352706 10571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:38.352710 10566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:38.353322 10559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:38.353904 10559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:38.355069 10559 hybrid_clock.cc:648] HybridClock initialized: now 1786078838355043 us; error 36 us; skew 500 ppm
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[10214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078838, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:38.361397 10559 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:00:38.362260 10559 webserver.cc:460] Webserver started at http://127.25.214.194:36569/ using document root <none> and password file <none>
I20260807 05:00:38.362797 10559 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:38.362855 10559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:38.363036 10559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:38.365069 10559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "1993c89e0c984609af8e24ecb66d883e"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "163962d1300dc6dd46d3b162b2b8a77d"
server_key_iv: "d02502bd80dc5817ac7c7044b5108d94"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.365569 10559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "1993c89e0c984609af8e24ecb66d883e"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "163962d1300dc6dd46d3b162b2b8a77d"
server_key_iv: "d02502bd80dc5817ac7c7044b5108d94"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.369158 10559 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 05:00:38.371421 10580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.372648 10559 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:00:38.372743 10559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "1993c89e0c984609af8e24ecb66d883e"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "163962d1300dc6dd46d3b162b2b8a77d"
server_key_iv: "d02502bd80dc5817ac7c7044b5108d94"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.372826 10559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:38.381966 10559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:38.384793 10559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:38.384958 10559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:38.385475 10559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:38.386302 10559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:38.386349 10559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.386389 10559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:38.386408 10559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.395051 10559 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:33025
I20260807 05:00:38.395113 10749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:33025 every 8 connection(s)
I20260807 05:00:38.396184 10559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:00:38.403227 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 10559
I20260807 05:00:38.403330 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:00:38.403586 26459 external_mini_cluster.cc:1428] Setting key 3c1348fb1a27ecf76cf99b4898928d57
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[10214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078838, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:38.410594 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.398109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:41009 (local address 127.25.214.254:35285)
0807 05:00:38.398240 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.398244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.399188 (+ 944us) server_negotiation.cc:407] Connection header received
0807 05:00:38.400680 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.400684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.400746 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.400827 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:38.402045 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.402585 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.403762 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.404036 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.404163 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.406936 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:38.406941 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:38.406943 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:38.406975 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:38.408473 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.408983 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.408987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.408988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.409079 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.409380 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.409383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.409385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.409624 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:38.409720 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.410253 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.410399 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:00:38.411439 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.398525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35285 (local address 127.25.214.194:41009)
0807 05:00:38.399011 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.399059 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.400449 (+ 1390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.401015 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.401023 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.401406 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:38.401900 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.401915 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.402707 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.402709 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.403655 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.403666 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.404211 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.404216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.404418 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.405054 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:38.405076 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:38.406745 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:38.408590 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:38.408596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:38.408611 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:38.408873 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:38.409159 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:38.409161 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:38.409162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:38.409300 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:38.409711 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:38.409715 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:38.409998 (+ 283us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.410162 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.410489 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":121,"threads_started":1}
I20260807 05:00:38.412726 10750 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35285
I20260807 05:00:38.413041 10750 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:38.413715 10750 heartbeater.cc:511] Master 127.25.214.254:35285 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:00:38.415110 10277 ts_manager.cc:194] Registered new tserver with Master: 1993c89e0c984609af8e24ecb66d883e (127.25.214.194:33025)
I20260807 05:00:38.415704 10277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:41009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:00:38.432615 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35285
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:00:38.547614 10756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:00:38.547878 10756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:00:38.547926 10756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:00:38.551908 10756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:00:38.551967 10756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:00:38.552028 10756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:00:38.557519 10756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:35285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:00:38.558687 10756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:00:38.559746 10756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:00:38.569478 10767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:38.569525 10756 server_base.cc:1034] running on GCE node
W20260807 05:00:38.569489 10770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:00:38.569483 10772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:00:38.570115 10756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:00:38.570791 10756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:00:38.571983 10756 hybrid_clock.cc:648] HybridClock initialized: now 1786078838571963 us; error 39 us; skew 500 ppm
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[10214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078838, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:00:38.575129 10756 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:00:38.576180 10756 webserver.cc:460] Webserver started at http://127.25.214.195:45145/ using document root <none> and password file <none>
I20260807 05:00:38.576807 10756 fs_manager.cc:359] Metadata directory not provided
I20260807 05:00:38.576882 10756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:00:38.577095 10756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:00:38.579187 10756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "e9949d3ccca14237b847645978a31641"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "56246f803643041c72eecb9b3f2fd815"
server_key_iv: "6ce8162e7dce5ab8318cc95a977d880b"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.579715 10756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "e9949d3ccca14237b847645978a31641"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "56246f803643041c72eecb9b3f2fd815"
server_key_iv: "6ce8162e7dce5ab8318cc95a977d880b"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.583410 10756 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 05:00:38.585858 10781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.587025 10756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:00:38.587152 10756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "e9949d3ccca14237b847645978a31641"
format_stamp: "Formatted at 2026-08-07 05:00:38 on dist-test-slave-lgr5"
server_key: "56246f803643041c72eecb9b3f2fd815"
server_key_iv: "6ce8162e7dce5ab8318cc95a977d880b"
server_key_version: "encryptionkey@0"
I20260807 05:00:38.587250 10756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:00:38.610369 10756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:00:38.613433 10756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:00:38.613617 10756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:00:38.614255 10756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:00:38.615134 10756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:00:38.615180 10756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.615236 10756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:00:38.615267 10756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:00:38.624579 10756 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:46215
I20260807 05:00:38.624675 10969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:46215 every 8 connection(s)
I20260807 05:00:38.625542 10756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:00:38.630084 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 10756
I20260807 05:00:38.630210 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:00:38.630486 26459 external_mini_cluster.cc:1428] Setting key 7c0e45aa1c692e3658c4e1b11505f23f
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[10214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078838, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:00:38.638993 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.627373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:53061 (local address 127.25.214.254:35285)
0807 05:00:38.627550 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.627554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.628463 (+ 909us) server_negotiation.cc:407] Connection header received
0807 05:00:38.629845 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.629848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.629908 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.629999 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:38.631312 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.631845 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.633052 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.633265 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.633353 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.635831 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:38.635834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:38.635837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:38.635870 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:38.637102 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.637591 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.637595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.637596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.637682 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.638024 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.638027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.638028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.638200 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:38.638270 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.638755 (+ 485us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.638868 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 05:00:38.639791 10974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.627748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:35285 (local address 127.25.214.195:53061)
0807 05:00:38.628285 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.628338 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.629621 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.630156 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.630163 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.630594 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:00:38.631168 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.631184 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.631975 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.631977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.632916 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.632927 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.633412 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.633417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.633580 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.634166 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:00:38.634182 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:00:38.635659 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:00:38.637215 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:38.637221 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:38.637234 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:38.637496 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:38.637788 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:00:38.637791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:00:38.637793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:00:38.637942 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:00:38.638295 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:00:38.638301 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:00:38.638552 (+ 251us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.638711 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.638972 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":150,"threads_started":1}
I20260807 05:00:38.640877 10971 heartbeater.cc:347] Connected to a master server at 127.25.214.254:35285
I20260807 05:00:38.641129 10971 heartbeater.cc:464] Registering TS with master...
I20260807 05:00:38.641623 10971 heartbeater.cc:511] Master 127.25.214.254:35285 requested a full tablet report, sending...
I20260807 05:00:38.642612 10277 ts_manager.cc:194] Registered new tserver with Master: e9949d3ccca14237b847645978a31641 (127.25.214.195:46215)
I20260807 05:00:38.643270 10277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:53061
I20260807 05:00:38.644295 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:00:38.653388 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.646199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47076 (local address 127.25.214.254:35285)
0807 05:00:38.646321 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.646325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.646497 (+ 172us) server_negotiation.cc:407] Connection header received
0807 05:00:38.646621 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.646624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.646666 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.646729 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:00:38.647471 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.647972 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.648806 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.649022 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.649110 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.650464 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:00:38.650468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:00:38.650470 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:00:38.650495 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:00:38.651614 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.652043 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.652047 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.652049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.652171 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:00:38.652455 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:00:38.652459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:00:38.652460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:00:38.652714 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:00:38.652846 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.653100 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.653219 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:00:38.656558 10277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:00:38.659641 10277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:00:38.673733 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.668658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:46281 (local address 127.0.0.1:42560)
0807 05:00:38.669335 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.669347 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.669425 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.670005 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.670007 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.670024 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:38.670116 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.670122 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.671122 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.671125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.672356 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.672366 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.673153 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.673157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.673304 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.673345 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.673445 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.673583 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":62,"thread_start_us":94,"threads_started":1}
I20260807 05:00:38.673745 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.668808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.25.214.193:46281)
0807 05:00:38.669218 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.669232 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.669440 (+ 208us) server_negotiation.cc:407] Connection header received
0807 05:00:38.669542 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.669546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.669689 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.669825 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:38.670242 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.670981 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.672469 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.673040 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.673154 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.673309 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.673487 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.673586 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":93,"threads_started":1}
I20260807 05:00:38.674698 10989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.667874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:46215 (local address 127.0.0.1:37500)
0807 05:00:38.668948 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.669003 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.669125 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.669825 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.669831 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.669855 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:38.670006 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.670015 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.671544 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.671547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.673069 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.673081 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.674317 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.674320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.674398 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.674416 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.674491 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.674565 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":162,"thread_start_us":99,"threads_started":1}
I20260807 05:00:38.674784 10990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.668076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37500 (local address 127.25.214.195:46215)
0807 05:00:38.669054 (+ 978us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.669076 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.669104 (+ 28us) server_negotiation.cc:407] Connection header received
0807 05:00:38.669396 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.669407 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.669660 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.669825 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:38.670137 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.671351 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.673212 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.674031 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.674143 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.674251 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.674546 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.674640 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":161,"threads_started":1}
I20260807 05:00:38.674898 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.668412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52724 (local address 127.25.214.194:33025)
0807 05:00:38.669037 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.669049 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.669344 (+ 295us) server_negotiation.cc:407] Connection header received
0807 05:00:38.669602 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.669606 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.669756 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.669901 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:38.670309 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.671419 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.673212 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.674031 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.674132 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.674251 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.674650 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.674747 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":141,"threads_started":1}
I20260807 05:00:38.675249 10992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.667939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:33025 (local address 127.0.0.1:52724)
0807 05:00:38.669245 (+ 1306us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.669259 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.669420 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.670052 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.670055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.670072 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:38.670158 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.670163 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.671544 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.671547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.673069 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.673081 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.674381 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.674385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.674483 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.674505 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.675040 (+ 535us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.675129 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1248,"mutex_wait_us":168,"thread_start_us":99,"threads_started":1}
I20260807 05:00:38.677258 10454 tablet_service.cc:1467] Processing CreateTablet for tablet f4aa5a51604a46febc90ff2283f55526 (DEFAULT_TABLE table=test-table [id=0466f2983f5c481597779602ab7a594d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:38.677424 10865 tablet_service.cc:1467] Processing CreateTablet for tablet f4aa5a51604a46febc90ff2283f55526 (DEFAULT_TABLE table=test-table [id=0466f2983f5c481597779602ab7a594d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:38.677795 10657 tablet_service.cc:1467] Processing CreateTablet for tablet f4aa5a51604a46febc90ff2283f55526 (DEFAULT_TABLE table=test-table [id=0466f2983f5c481597779602ab7a594d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:00:38.678289 10454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4aa5a51604a46febc90ff2283f55526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:38.678504 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4aa5a51604a46febc90ff2283f55526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:38.678745 10657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4aa5a51604a46febc90ff2283f55526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:00:38.685424 10994 tablet_bootstrap.cc:492] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: Bootstrap starting.
I20260807 05:00:38.686348 10996 tablet_bootstrap.cc:492] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Bootstrap starting.
I20260807 05:00:38.686741 10995 tablet_bootstrap.cc:492] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Bootstrap starting.
I20260807 05:00:38.687755 10994 tablet_bootstrap.cc:654] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:38.688457 10996 tablet_bootstrap.cc:654] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:38.688889 10994 log.cc:824] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:38.689132 10995 tablet_bootstrap.cc:654] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Neither blocks nor log segments found. Creating new log.
I20260807 05:00:38.689713 10996 log.cc:824] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:38.689867 10995 log.cc:824] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Log is configured to *not* fsync() on all Append() calls
I20260807 05:00:38.690963 10994 tablet_bootstrap.cc:492] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: No bootstrap required, opened a new log
I20260807 05:00:38.691174 10994 ts_tablet_manager.cc:1397] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260807 05:00:38.691648 10996 tablet_bootstrap.cc:492] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: No bootstrap required, opened a new log
I20260807 05:00:38.691812 10996 ts_tablet_manager.cc:1397] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:00:38.693305 10995 tablet_bootstrap.cc:492] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: No bootstrap required, opened a new log
I20260807 05:00:38.693490 10995 ts_tablet_manager.cc:1397] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 05:00:38.694227 10994 raft_consensus.cc:348] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.694496 10994 raft_consensus.cc:374] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:38.694562 10994 raft_consensus.cc:729] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae7d1db15a6849f0a3d296daa0265d40, State: Initialized, Role: FOLLOWER
I20260807 05:00:38.695029 10994 consensus_queue.cc:260] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.695817 10554 heartbeater.cc:503] Master 127.25.214.254:35285 was elected leader, sending a full tablet report...
I20260807 05:00:38.696066 10994 ts_tablet_manager.cc:1428] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 05:00:38.696877 10996 raft_consensus.cc:348] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.697149 10996 raft_consensus.cc:374] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:38.697211 10996 raft_consensus.cc:729] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9949d3ccca14237b847645978a31641, State: Initialized, Role: FOLLOWER
I20260807 05:00:38.697649 10996 consensus_queue.cc:260] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.698431 10971 heartbeater.cc:503] Master 127.25.214.254:35285 was elected leader, sending a full tablet report...
I20260807 05:00:38.698707 10996 ts_tablet_manager.cc:1428] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 05:00:38.699016 10995 raft_consensus.cc:348] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.699236 10995 raft_consensus.cc:374] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:00:38.699290 10995 raft_consensus.cc:729] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993c89e0c984609af8e24ecb66d883e, State: Initialized, Role: FOLLOWER
I20260807 05:00:38.699690 10995 consensus_queue.cc:260] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.700378 10750 heartbeater.cc:503] Master 127.25.214.254:35285 was elected leader, sending a full tablet report...
I20260807 05:00:38.700693 10995 ts_tablet_manager.cc:1428] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 05:00:38.791905 11005 raft_consensus.cc:482] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:00:38.792142 11005 raft_consensus.cc:504] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.793361 11005 leader_election.cc:288] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993c89e0c984609af8e24ecb66d883e (127.25.214.194:33025), ae7d1db15a6849f0a3d296daa0265d40 (127.25.214.193:46281)
I20260807 05:00:38.797446 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.793820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:41133 (local address 127.25.214.194:33025)
0807 05:00:38.793948 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.793952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.793966 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:00:38.794031 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.794034 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.794087 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.794160 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:38.794523 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.795130 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.796415 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.796820 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.796931 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.796991 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.797232 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.797310 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:00:38.797469 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.793789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:39421 (local address 127.25.214.193:46281)
0807 05:00:38.793949 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.793955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.794146 (+ 191us) server_negotiation.cc:407] Connection header received
0807 05:00:38.794263 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.794266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.794316 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.794414 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:00:38.794654 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.795182 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.796419 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.796822 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.796943 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.797003 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.797236 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.797308 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 05:00:38.797475 10974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.793603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:33025 (local address 127.25.214.195:41133)
0807 05:00:38.793715 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.793730 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.793827 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.794196 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.794200 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.794227 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:38.794381 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.794390 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.795239 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.795243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.796282 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.796293 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.796938 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.796942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.797089 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.797117 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.797189 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.797286 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":35}
I20260807 05:00:38.797487 11009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.793685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:46281 (local address 127.25.214.195:39421)
0807 05:00:38.794057 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.794069 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:00:38.794166 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:00:38.794419 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:00:38.794421 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:00:38.794434 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:00:38.794561 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.794567 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.795307 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.795309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.796287 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:00:38.796299 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.796941 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.796945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:00:38.797119 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.797137 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 05:00:38.797207 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 05:00:38.797306 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":99,"thread_start_us":141,"threads_started":1}
I20260807 05:00:38.798291 10483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4aa5a51604a46febc90ff2283f55526" candidate_uuid: "e9949d3ccca14237b847645978a31641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae7d1db15a6849f0a3d296daa0265d40" is_pre_election: true
I20260807 05:00:38.798293 10688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4aa5a51604a46febc90ff2283f55526" candidate_uuid: "e9949d3ccca14237b847645978a31641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993c89e0c984609af8e24ecb66d883e" is_pre_election: true
I20260807 05:00:38.798620 10688 raft_consensus.cc:2454] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9949d3ccca14237b847645978a31641 in term 0.
I20260807 05:00:38.798622 10483 raft_consensus.cc:2454] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9949d3ccca14237b847645978a31641 in term 0.
I20260807 05:00:38.799163 10783 leader_election.cc:302] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1993c89e0c984609af8e24ecb66d883e, ae7d1db15a6849f0a3d296daa0265d40, e9949d3ccca14237b847645978a31641; no voters:
I20260807 05:00:38.799489 11005 raft_consensus.cc:2781] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:00:38.799578 11005 raft_consensus.cc:482] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:00:38.799610 11005 raft_consensus.cc:3037] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:38.800738 11005 raft_consensus.cc:504] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.801131 11005 leader_election.cc:288] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [CANDIDATE]: Term 1 election: Requested vote from peers 1993c89e0c984609af8e24ecb66d883e (127.25.214.194:33025), ae7d1db15a6849f0a3d296daa0265d40 (127.25.214.193:46281)
I20260807 05:00:38.801596 10483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4aa5a51604a46febc90ff2283f55526" candidate_uuid: "e9949d3ccca14237b847645978a31641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae7d1db15a6849f0a3d296daa0265d40"
I20260807 05:00:38.801743 10483 raft_consensus.cc:3037] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:38.801733 10688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4aa5a51604a46febc90ff2283f55526" candidate_uuid: "e9949d3ccca14237b847645978a31641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993c89e0c984609af8e24ecb66d883e"
I20260807 05:00:38.801883 10688 raft_consensus.cc:3037] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:00:38.802816 10483 raft_consensus.cc:2454] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9949d3ccca14237b847645978a31641 in term 1.
I20260807 05:00:38.803100 10688 raft_consensus.cc:2454] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9949d3ccca14237b847645978a31641 in term 1.
I20260807 05:00:38.803144 10783 leader_election.cc:302] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae7d1db15a6849f0a3d296daa0265d40, e9949d3ccca14237b847645978a31641; no voters:
I20260807 05:00:38.803355 11005 raft_consensus.cc:2781] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:00:38.803610 11005 raft_consensus.cc:686] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 1 LEADER]: Becoming Leader. State: Replica: e9949d3ccca14237b847645978a31641, State: Running, Role: LEADER
I20260807 05:00:38.803989 11005 consensus_queue.cc:237] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } }
I20260807 05:00:38.807152 10276 catalog_manager.cc:5495] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9949d3ccca14237b847645978a31641 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "e9949d3ccca14237b847645978a31641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9949d3ccca14237b847645978a31641" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 46215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 } health_report { overall_health: UNKNOWN } } }
I20260807 05:00:38.828369 10990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.824954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37504 (local address 127.25.214.195:46215)
0807 05:00:38.825077 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 05:00:38.825081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:00:38.825096 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:00:38.825173 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:00:38.825175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:00:38.825231 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:00:38.825315 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:00:38.825523 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.826028 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.826950 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:00:38.827174 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:00:38.827253 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:00:38.827553 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:00:38.828005 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:00:38.828144 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 05:00:38.828182 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 05:00:38.828235 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:00:38.834486 10483 raft_consensus.cc:1261] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 1 FOLLOWER]: Refusing update from remote peer e9949d3ccca14237b847645978a31641: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:38.834507 10688 raft_consensus.cc:1261] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 1 FOLLOWER]: Refusing update from remote peer e9949d3ccca14237b847645978a31641: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:00:38.835170 11005 consensus_queue.cc:1035] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae7d1db15a6849f0a3d296daa0265d40" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:38.835402 11010 consensus_queue.cc:1035] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993c89e0c984609af8e24ecb66d883e" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:00:38.843597 11015 mvcc.cc:205] Tried to move back new op lower bound from 7315778923858440192 to 7315778923743916032. Current Snapshot: MvccSnapshot[applied={T|T < 7315778923858440192}]
I20260807 05:00:38.844807 11017 mvcc.cc:205] Tried to move back new op lower bound from 7315778923858440192 to 7315778923743916032. Current Snapshot: MvccSnapshot[applied={T|T < 7315778923858440192}]
I20260807 05:00:38.851643 10276 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:38.851801 10276 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:00:38.854130 10276 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de4afb1186e8454ca5408a7b3e22d4a0: Sending DeleteTablet for 3 replicas of tablet f4aa5a51604a46febc90ff2283f55526
I20260807 05:00:38.854889 10657 tablet_service.cc:1514] Processing DeleteTablet for tablet f4aa5a51604a46febc90ff2283f55526 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:38 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:52724
I20260807 05:00:38.854957 10454 tablet_service.cc:1514] Processing DeleteTablet for tablet f4aa5a51604a46febc90ff2283f55526 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:38 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:42560
I20260807 05:00:38.855034 10865 tablet_service.cc:1514] Processing DeleteTablet for tablet f4aa5a51604a46febc90ff2283f55526 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:00:38 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:37500
I20260807 05:00:38.855445 11029 tablet_replica.cc:330] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40: stopping tablet replica
I20260807 05:00:38.855759 11027 tablet_replica.cc:330] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: stopping tablet replica
I20260807 05:00:38.855791 11029 raft_consensus.cc:2229] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:38.856145 11029 raft_consensus.cc:2258] T f4aa5a51604a46febc90ff2283f55526 P ae7d1db15a6849f0a3d296daa0265d40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:38.856213 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 10364
I20260807 05:00:38.856171 11027 raft_consensus.cc:2229] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:00:38.856634 11027 raft_consensus.cc:2258] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:38.863608 11033 tablet_replica.cc:330] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: stopping tablet replica
I20260807 05:00:38.863595 11027 ts_tablet_manager.cc:1905] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:38.863935 11033 raft_consensus.cc:2229] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:00:38.864406 11033 raft_consensus.cc:2258] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:00:38.865873 11033 ts_tablet_manager.cc:1905] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:00:38.867110 11027 ts_tablet_manager.cc:1918] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:38.867275 11027 log.cc:1196] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/f4aa5a51604a46febc90ff2283f55526
I20260807 05:00:38.867739 11027 ts_tablet_manager.cc:1939] T f4aa5a51604a46febc90ff2283f55526 P 1993c89e0c984609af8e24ecb66d883e: Deleting consensus metadata
I20260807 05:00:38.868547 11033 ts_tablet_manager.cc:1918] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:00:38.868643 11033 log.cc:1196] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/f4aa5a51604a46febc90ff2283f55526
I20260807 05:00:38.868927 11033 ts_tablet_manager.cc:1939] T f4aa5a51604a46febc90ff2283f55526 P e9949d3ccca14237b847645978a31641: Deleting consensus metadata
I20260807 05:00:38.869483 10260 catalog_manager.cc:4841] TS 1993c89e0c984609af8e24ecb66d883e (127.25.214.194:33025): tablet f4aa5a51604a46febc90ff2283f55526 (table test-table [id=0466f2983f5c481597779602ab7a594d]) successfully deleted
I20260807 05:00:38.869992 10257 catalog_manager.cc:4841] TS e9949d3ccca14237b847645978a31641 (127.25.214.195:46215): tablet f4aa5a51604a46febc90ff2283f55526 (table test-table [id=0466f2983f5c481597779602ab7a594d]) successfully deleted
W20260807 05:00:38.871302 10257 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:46281 (error 108)
I20260807 05:00:38.872195 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 10559
I20260807 05:00:38.878156 10992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:00:38.872454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:46281 (local address 127.0.0.1:42572)
0807 05:00:38.877979 (+ 5525us) negotiation.cc:107] Waiting for socket to connect
0807 05:00:38.878064 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:46281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5414}
W20260807 05:00:38.880147 10257 catalog_manager.cc:4584] TS ae7d1db15a6849f0a3d296daa0265d40 (127.25.214.193:46281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f4aa5a51604a46febc90ff2283f55526: Network error: Client connection negotiation failed: client connection to 127.25.214.193:46281: connect: Connection refused (error 111)
I20260807 05:00:38.890744 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 10756
I20260807 05:00:38.904374 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 10228
2026-08-07T05:00:38Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2496 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[11040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[11040](info): set up 2 sockets
Aug 07 05:00:38 dist-test-slave-lgr5 krb5kdc[11040](info): commencing operation
krb5kdc: starting...
W20260807 05:00:40.052187 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:00:40 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:00:40Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/rangeradmin_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/rangeradmin_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/rangerlookup_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/rangerlookup_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
I20260807 05:00:40.224897 26459 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZKK2Ci/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/postgres -l logfile start
2026-08-07 05:00:42.654 UTC [11081] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 05:00:42.654 UTC [11081] LOG: listening on IPv4 address "127.25.214.212", port 38497
2026-08-07 05:00:42.657 UTC [11081] LOG: listening on Unix socket "/tmp/.s.PGSQL.38497"
2026-08-07 05:00:42.678 UTC [11084] LOG: database system was shut down at 2026-08-07 05:00:41 UTC
2026-08-07 05:00:42.681 UTC [11081] LOG: database system is ready to accept connections
I20260807 05:00:43.728117 26459 mini_postgres.cc:96] Postgres bound to 38497
2026-08-07 05:00:43.737 UTC [11097] FATAL: database "slave" does not exist
127.25.214.212:38497 - accepting connections
I20260807 05:00:43.738579 26459 mini_ranger.cc:161] Starting Ranger...
I20260807 05:00:43.756335 26459 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 05:00:44.237957 26459 mini_ranger.cc:87] Created ranger Postgres database
I20260807 05:00:44.238065 26459 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-admin
2026-08-07 05:00:44,574 [I] DB FLAVOR :POSTGRES
2026-08-07 05:00:44,575 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 05:00:44,575 [I] Checking connection..
2026-08-07 05:00:44,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 05:00:44,846 [I] Checking connection passed.
2026-08-07 05:00:44,846 [I] --------- Verifying version history table ---------
2026-08-07 05:00:44,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 05:00:45,091 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 05:00:45,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 05:00:45,366 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 05:00:45,367 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 05:00:45,367 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 05:00:45.614 UTC [11191] WARNING: there is no transaction in progress
2026-08-07 05:00:45,621 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 05:00:45,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 05:00:45,891 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 05:00:45,892 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 05:00:45,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 05:00:46,335 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 05:00:46,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-07 05:00:47,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 05:00:47,745 [I] Table x_portal_user does not exist in database ranger
2026-08-07 05:00:47,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 05:00:47,999 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 05:00:48,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 05:00:48,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 05:00:48,507 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 05:00:48,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 05:00:49.504 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.522 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.539 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.554 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.571 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.589 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.643 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.650 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.663 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.673 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.684 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.698 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.707 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.713 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.719 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:49.725 UTC [11358] WARNING: there is no transaction in progress
2026-08-07 05:00:50,347 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 05:00:50,348 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 05:00:50,613 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 05:00:50,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 05:00:50,887 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 05:00:50,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 05:00:51,131 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 05:00:51,132 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 05:00:51,403 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 05:00:51,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-07 05:00:51,906 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 05:00:51,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 05:00:52,169 [I] DB_PATCHES have already been applied
I20260807 05:00:52.175209 26459 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZKK2Ci/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 05:00:52.175287 26459 mini_ranger.cc:193] Using host: 127.25.214.212
I20260807 05:00:52.180186 26459 mini_ranger.cc:227] Ranger admin URL: http://127.25.214.212:34239
Aug 07, 2026 5:00:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 5:00:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 5:00:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 5:00:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 5:00:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 5:00:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 5:00:53 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 05:00:53.411252 26459 mini_ranger.cc:160] Time spent starting Ranger: real 9.673s user 0.000s sys 0.012s
Aug 07, 2026 5:01:13 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 5:01:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 5:01:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 5:01:13 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 5:01:14 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 05:01:15.391824 26459 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/rangerkms_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/rangerkms_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.214.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.214.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 05:01:15 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078875, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 05:01:15.473986 26459 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 05:01:15.483202 26459 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 05:01:16.300752 26459 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 05:01:16.300861 26459 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms
I20260807 05:01:16.300959 26459 mini_ranger_kms.cc:227] Using postgres at 127.25.214.212:38497
2026-08-07 05:01:16,522 [I] DB FLAVOR :POSTGRES
2026-08-07 05:01:16,523 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 05:01:16,523 [I] Checking connection
2026-08-07 05:01:16,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 05:01:16,764 [I] connection success
2026-08-07 05:01:16,765 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 05:01:16,765 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 05:01:16,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 05:01:17,004 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 05:01:17,005 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 05:01:17,005 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 05:01:17,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:38497/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 05:01:17,285 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 05:01:17.787259 26459 mini_ranger_kms.cc:310] Created kms service
I20260807 05:01:17.958990 26459 mini_ranger_kms.cc:326] Created kudu user
I20260807 05:01:18.004946 26459 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 05:01:18 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078875, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:01:18.404064 26459 mini_ranger_kms.cc:384] Added ranger policy
I20260807 05:01:18.404251 26459 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 05:01:18.404271 26459 mini_ranger_kms.cc:240] Using host: 127.25.214.212
I20260807 05:01:18.409057 26459 mini_ranger_kms.cc:276] Ranger KMS PID: 11615
I20260807 05:01:18.409266 26459 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.214.212:52989
Aug 07, 2026 5:01:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 5:01:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 5:01:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 5:01:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 5:01:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 5:01:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 05:01:20 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786078880, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.214.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:01:20.835922 26459 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.362s user 0.006s sys 0.199s
I20260807 05:01:20.836052 26459 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 05:01:20.836199 26459 mini_ranger_kms.cc:401] 127.25.214.212:52989/kms/v1/keys
Aug 07 05:01:21 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078880, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.214.212@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
Aug 07 05:01:21 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078880, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.214.212@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
Aug 07 05:01:23 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:01:23.766739 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45797
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:45797
--ranger_config_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:52989/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:01:23.881206 11689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:01:23.881501 11689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:01:23.881541 11689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:01:23.885650 11689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:01:23.885725 11689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:01:23.885743 11689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:01:23.885758 11689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:01:23.885771 11689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:01:23.891307 11689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.214.212:52989/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:45797
--ranger_config_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:45797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:01:23.892375 11689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:01:23.893399 11689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:01:23.902004 11703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:23.902037 11701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:23.902055 11698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:01:23.902113 11689 server_base.cc:1034] running on GCE node
I20260807 05:01:23.902853 11689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:01:23.903941 11689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:01:23.905098 11689 hybrid_clock.cc:648] HybridClock initialized: now 1786078883905082 us; error 32 us; skew 500 ppm
Aug 07 05:01:23 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078883, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:01:23.911715 11689 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:01:23.912775 11689 webserver.cc:460] Webserver started at http://127.25.214.254:34481/ using document root <none> and password file <none>
I20260807 05:01:23.913316 11689 fs_manager.cc:359] Metadata directory not provided
I20260807 05:01:23.913376 11689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:01:23.913565 11689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:01:23 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078883, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:01:23.970315 11689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "0bbbce9c4e8643569910157e706a88b5"
format_stamp: "Formatted at 2026-08-07 05:01:23 on dist-test-slave-lgr5"
server_key: "69e544a679b5e2c1488b54b4dead9930"
server_key_iv: "7aefd06a3f605aca219744e945e1a029"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:23.970986 11689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "0bbbce9c4e8643569910157e706a88b5"
format_stamp: "Formatted at 2026-08-07 05:01:23 on dist-test-slave-lgr5"
server_key: "69e544a679b5e2c1488b54b4dead9930"
server_key_iv: "7aefd06a3f605aca219744e945e1a029"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:23.976184 11689 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 05:01:23.995440 11716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:23.997217 11689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:01:23.997383 11689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "0bbbce9c4e8643569910157e706a88b5"
format_stamp: "Formatted at 2026-08-07 05:01:23 on dist-test-slave-lgr5"
server_key: "69e544a679b5e2c1488b54b4dead9930"
server_key_iv: "7aefd06a3f605aca219744e945e1a029"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:23.997550 11689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:01:24.017652 11689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:01:24.020359 11689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:01:24.020524 11689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:01:24.027498 11689 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:45797
I20260807 05:01:24.027516 11794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:45797 every 8 connection(s)
I20260807 05:01:24.028494 11689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:01:24.031255 11795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:01:24.035502 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 11689
I20260807 05:01:24.035638 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:01:24.035924 26459 external_mini_cluster.cc:1428] Setting key 43cf6e8c539fc8eb62a17e9ef487b31a
I20260807 05:01:24.037418 11795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5: Bootstrap starting.
I20260807 05:01:24.039803 11795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5: Neither blocks nor log segments found. Creating new log.
I20260807 05:01:24.040614 11795 log.cc:824] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:01:24.042429 11795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5: No bootstrap required, opened a new log
Aug 07 05:01:24 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:01:24.046525 11795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bbbce9c4e8643569910157e706a88b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45797 } }
I20260807 05:01:24.046816 11795 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:01:24.046875 11795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bbbce9c4e8643569910157e706a88b5, State: Initialized, Role: FOLLOWER
I20260807 05:01:24.047379 11795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bbbce9c4e8643569910157e706a88b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45797 } }
I20260807 05:01:24.047518 11795 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:01:24.047580 11795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:01:24.047674 11795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:01:24.048662 11795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bbbce9c4e8643569910157e706a88b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45797 } }
I20260807 05:01:24.049026 11795 leader_election.cc:302] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bbbce9c4e8643569910157e706a88b5; no voters:
I20260807 05:01:24.050443 11799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:24.037402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37414 (local address 127.25.214.254:45797)
0807 05:01:24.037808 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:24.037825 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:24.037863 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:01:24.038534 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:24.038552 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:24.038879 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:24.039154 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:01:24.040068 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:24.041139 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:24.041985 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:24.042453 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:24.042597 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:24.045284 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:01:24.045291 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:01:24.045309 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:01:24.045340 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:01:24.047245 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:24.047744 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:24.047751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:24.047757 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:24.047878 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:24.048223 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:24.048226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:24.048227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:24.048744 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:01:24.048987 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:24.049264 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 05:01:24.049533 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":126,"threads_started":1}
I20260807 05:01:24.050590 11795 leader_election.cc:288] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:01:24.050972 11802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:01:24.051990 11795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:01:24.052137 11802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [term 1 LEADER]: Becoming Leader. State: Replica: 0bbbce9c4e8643569910157e706a88b5, State: Running, Role: LEADER
I20260807 05:01:24.052511 11802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bbbce9c4e8643569910157e706a88b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45797 } }
I20260807 05:01:24.054445 11803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bbbce9c4e8643569910157e706a88b5. Latest consensus state: current_term: 1 leader_uuid: "0bbbce9c4e8643569910157e706a88b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bbbce9c4e8643569910157e706a88b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45797 } } }
I20260807 05:01:24.054574 11803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [sys.catalog]: This master's current role is: LEADER
I20260807 05:01:24.055020 11801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bbbce9c4e8643569910157e706a88b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bbbce9c4e8643569910157e706a88b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 45797 } } }
I20260807 05:01:24.055038 11795 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 05:01:24.055177 11817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:01:24.056602 11801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5 [sys.catalog]: This master's current role is: LEADER
I20260807 05:01:24.061110 11817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:01:24.068300 11817 catalog_manager.cc:1347] Generated new cluster ID: 791b4938f8ea4388b018e050e00651f5
I20260807 05:01:24.068379 11817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:01:24.079542 11817 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:01:24.080667 11817 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:01:24.086609 11817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5: Generated new TSK 0
I20260807 05:01:24.087527 11817 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:01:24.765261 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:52989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45797
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:01:24.885274 11857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:01:24.885555 11857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:01:24.885617 11857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:01:24.889950 11857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:01:24.890020 11857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:01:24.890101 11857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:01:24.895619 11857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.214.212:52989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:01:24.896739 11857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:01:24.897769 11857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:01:24.908617 11871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:24.908752 11874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:24.908615 11870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:01:24.909554 11857 server_base.cc:1034] running on GCE node
I20260807 05:01:24.910081 11857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:01:24.910938 11857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:01:24.912142 11857 hybrid_clock.cc:648] HybridClock initialized: now 1786078884912124 us; error 30 us; skew 500 ppm
Aug 07 05:01:24 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078884, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:01:24.915637 11857 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:01:24.916822 11857 webserver.cc:460] Webserver started at http://127.25.214.193:33025/ using document root <none> and password file <none>
I20260807 05:01:24.917573 11857 fs_manager.cc:359] Metadata directory not provided
I20260807 05:01:24.917668 11857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:01:24.917955 11857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:01:24 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078884, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:01:24.932063 11857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "779a54fd97a043c78fc10bc2eeef5791"
format_stamp: "Formatted at 2026-08-07 05:01:24 on dist-test-slave-lgr5"
server_key: "cbddb59d59e5b4219ae990fd0ba710ae"
server_key_iv: "d200bab99c8d8fd518449bd463b01f58"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:24.932956 11857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "779a54fd97a043c78fc10bc2eeef5791"
format_stamp: "Formatted at 2026-08-07 05:01:24 on dist-test-slave-lgr5"
server_key: "cbddb59d59e5b4219ae990fd0ba710ae"
server_key_iv: "d200bab99c8d8fd518449bd463b01f58"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:24.937485 11857 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:01:24.956771 11884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:24.958650 11857 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:01:24.958868 11857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "779a54fd97a043c78fc10bc2eeef5791"
format_stamp: "Formatted at 2026-08-07 05:01:24 on dist-test-slave-lgr5"
server_key: "cbddb59d59e5b4219ae990fd0ba710ae"
server_key_iv: "d200bab99c8d8fd518449bd463b01f58"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:24.959113 11857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:01:24.985471 11857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:01:24.989226 11857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:01:24.989464 11857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:01:24.990285 11857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:01:24.991448 11857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:01:24.991523 11857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:24.991593 11857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:01:24.991624 11857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.003098 11857 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:43613
I20260807 05:01:25.003147 12046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:43613 every 8 connection(s)
I20260807 05:01:25.004335 11857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:01:25.013954 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 11857
I20260807 05:01:25.014089 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:01:25.014434 26459 external_mini_cluster.cc:1428] Setting key e1f79fb773cf9e0bb0c3bad7218d3a84
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078884, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:01:25.021950 12051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.008154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:47093 (local address 127.25.214.254:45797)
0807 05:01:25.008445 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.008454 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.008473 (+ 19us) server_negotiation.cc:407] Connection header received
0807 05:01:25.009277 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.009281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.009342 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.009436 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:01:25.010935 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.011840 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.013572 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.013950 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.014057 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.017454 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:01:25.017458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:01:25.017461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:01:25.017488 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:01:25.019422 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.020049 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.020053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.020055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.020196 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.020594 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.020597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.020599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.020825 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:01:25.020937 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.021554 (+ 617us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.021685 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
I20260807 05:01:25.022862 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.007089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45797 (local address 127.25.214.193:47093)
0807 05:01:25.007807 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.007877 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.008940 (+ 1063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.009687 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.009696 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.010054 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:01:25.010753 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.010774 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.011995 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.012000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.013427 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.013439 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.014241 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.014246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.014455 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.015449 (+ 994us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:01:25.015473 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:01:25.017258 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:01:25.019561 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:01:25.019568 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:01:25.019584 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:01:25.019932 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:01:25.020286 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:01:25.020289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:01:25.020291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:01:25.020489 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:01:25.020950 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:01:25.020956 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:01:25.021261 (+ 305us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.021471 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.021794 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":167,"threads_started":1}
I20260807 05:01:25.024336 12047 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45797
I20260807 05:01:25.024618 12047 heartbeater.cc:464] Registering TS with master...
I20260807 05:01:25.025213 12047 heartbeater.cc:511] Master 127.25.214.254:45797 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:01:25.027041 11743 ts_manager.cc:194] Registered new tserver with Master: 779a54fd97a043c78fc10bc2eeef5791 (127.25.214.193:43613)
I20260807 05:01:25.028642 11743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:47093
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:01:25.047971 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:52989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45797
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 05:01:25.187098 12054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:01:25.187487 12054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:01:25.187619 12054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:01:25.191883 12054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:01:25.191951 12054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:01:25.192032 12054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:01:25.197422 12054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.214.212:52989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:01:25.198793 12054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:01:25.199960 12054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:01:25.209712 12066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:25.210027 12068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:25.209883 12065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:01:25.210284 12054 server_base.cc:1034] running on GCE node
I20260807 05:01:25.210784 12054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:01:25.211454 12054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:01:25.212702 12054 hybrid_clock.cc:648] HybridClock initialized: now 1786078885212674 us; error 39 us; skew 500 ppm
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:01:25.216616 12054 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:01:25.217928 12054 webserver.cc:460] Webserver started at http://127.25.214.194:45581/ using document root <none> and password file <none>
I20260807 05:01:25.218736 12054 fs_manager.cc:359] Metadata directory not provided
I20260807 05:01:25.218833 12054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:01:25.219156 12054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:01:25.240761 12054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "7663b821c25d4681a4eb350b2c82939c"
format_stamp: "Formatted at 2026-08-07 05:01:25 on dist-test-slave-lgr5"
server_key: "7212276ce0995f2f44560cdb03d2f7ea"
server_key_iv: "d0492a86a6a52ddf9e6d07e394769f3c"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:25.241715 12054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "7663b821c25d4681a4eb350b2c82939c"
format_stamp: "Formatted at 2026-08-07 05:01:25 on dist-test-slave-lgr5"
server_key: "7212276ce0995f2f44560cdb03d2f7ea"
server_key_iv: "d0492a86a6a52ddf9e6d07e394769f3c"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:25.247148 12054 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 05:01:25.264806 12080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.266347 12054 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260807 05:01:25.266491 12054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "7663b821c25d4681a4eb350b2c82939c"
format_stamp: "Formatted at 2026-08-07 05:01:25 on dist-test-slave-lgr5"
server_key: "7212276ce0995f2f44560cdb03d2f7ea"
server_key_iv: "d0492a86a6a52ddf9e6d07e394769f3c"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:25.266630 12054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:01:25.289546 12054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:01:25.293406 12054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:01:25.293684 12054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:01:25.294481 12054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:01:25.295631 12054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:01:25.295740 12054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.295845 12054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:01:25.295910 12054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.309402 12054 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:43345
I20260807 05:01:25.310642 12054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:01:25.311092 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 12054
I20260807 05:01:25.311236 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:01:25.311573 26459 external_mini_cluster.cc:1428] Setting key 58380d46cab375056e7c26f129f8ddc0
I20260807 05:01:25.312496 12252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:43345 every 8 connection(s)
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:01:25.334493 12051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.316067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:34997 (local address 127.25.214.254:45797)
0807 05:01:25.316217 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.316221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.316797 (+ 576us) server_negotiation.cc:407] Connection header received
0807 05:01:25.318092 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.318095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.318152 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.318206 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:01:25.319903 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.320757 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.324294 (+ 3537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.324670 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.324748 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.330421 (+ 5673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:01:25.330425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:01:25.330429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:01:25.330458 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:01:25.332115 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.332850 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.332854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.332856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.332944 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.333362 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.333365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.333367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.333585 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:01:25.333681 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.334192 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.334322 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 05:01:25.335855 12261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.315000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45797 (local address 127.25.214.194:34997)
0807 05:01:25.316651 (+ 1651us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.316703 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.317838 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.318667 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.318676 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.319022 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:01:25.319712 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.319734 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.320920 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.320924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.322316 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.322327 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.324961 (+ 2634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.324965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.325164 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.328424 (+ 3260us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:01:25.328446 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:01:25.330204 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:01:25.332314 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:01:25.332321 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:01:25.332337 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:01:25.332727 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:01:25.333057 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:01:25.333060 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:01:25.333062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:01:25.333243 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:01:25.333682 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:01:25.333689 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:01:25.333948 (+ 259us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.334114 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.334564 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1439,"thread_start_us":140,"threads_started":1}
I20260807 05:01:25.337639 12257 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45797
I20260807 05:01:25.337885 12257 heartbeater.cc:464] Registering TS with master...
I20260807 05:01:25.338477 12257 heartbeater.cc:511] Master 127.25.214.254:45797 requested a full tablet report, sending...
I20260807 05:01:25.339628 11743 ts_manager.cc:194] Registered new tserver with Master: 7663b821c25d4681a4eb350b2c82939c (127.25.214.194:43345)
I20260807 05:01:25.340412 11743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:34997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:01:25.359862 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:52989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45797
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:01:25.524281 12267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:01:25.525027 12267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:01:25.525153 12267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:01:25.531213 12267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:01:25.531340 12267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:01:25.531468 12267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:01:25.539397 12267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.214.212:52989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:45797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:01:25.541011 12267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:01:25.542482 12267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:01:25.556329 12279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:01:25.556388 12277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:01:25.558135 12267 server_base.cc:1034] running on GCE node
W20260807 05:01:25.560241 12276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:01:25.560817 12267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:01:25.561610 12267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:01:25.562762 12267 hybrid_clock.cc:648] HybridClock initialized: now 1786078885562699 us; error 80 us; skew 500 ppm
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:01:25.566869 12267 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:01:25.568019 12267 webserver.cc:460] Webserver started at http://127.25.214.195:46325/ using document root <none> and password file <none>
I20260807 05:01:25.568763 12267 fs_manager.cc:359] Metadata directory not provided
I20260807 05:01:25.568838 12267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:01:25.569069 12267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:01:25.594707 12267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "92d535029e0f466099989c3026df8021"
format_stamp: "Formatted at 2026-08-07 05:01:25 on dist-test-slave-lgr5"
server_key: "e6f82812261925901074dd6551be70d4"
server_key_iv: "23c7c8b533dec575e8e0d1290b7754e9"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:25.595688 12267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "92d535029e0f466099989c3026df8021"
format_stamp: "Formatted at 2026-08-07 05:01:25 on dist-test-slave-lgr5"
server_key: "e6f82812261925901074dd6551be70d4"
server_key_iv: "23c7c8b533dec575e8e0d1290b7754e9"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:25.601459 12267 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260807 05:01:25.623761 12289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.625770 12267 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260807 05:01:25.625952 12267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "92d535029e0f466099989c3026df8021"
format_stamp: "Formatted at 2026-08-07 05:01:25 on dist-test-slave-lgr5"
server_key: "e6f82812261925901074dd6551be70d4"
server_key_iv: "23c7c8b533dec575e8e0d1290b7754e9"
server_key_version: "kuduclusterkey@0"
I20260807 05:01:25.626122 12267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:01:25.649843 12267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:01:25.654369 12267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:01:25.654656 12267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:01:25.655431 12267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:01:25.656582 12267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:01:25.656692 12267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.656790 12267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:01:25.656850 12267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:01:25.670419 12267 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:43501
I20260807 05:01:25.671995 12267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:01:25.673657 12438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:43501 every 8 connection(s)
I20260807 05:01:25.681663 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 12267
I20260807 05:01:25.681797 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:01:25.682075 26459 external_mini_cluster.cc:1428] Setting key ccd202380c330fba3a5ef74f7b945afe
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:01:25.696802 12051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.677214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:35561 (local address 127.25.214.254:45797)
0807 05:01:25.677342 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.677347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.678339 (+ 992us) server_negotiation.cc:407] Connection header received
0807 05:01:25.679622 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.679626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.679684 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.679735 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:01:25.684531 (+ 4796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.685369 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.687191 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.687562 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.687636 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.690830 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:01:25.690834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:01:25.690837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:01:25.690866 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:01:25.692539 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.693163 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.693166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.693168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.693256 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.693670 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.693673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.693675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.693902 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:01:25.693981 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.696478 (+ 2497us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.696629 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:01:25.698791 12444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.676030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:45797 (local address 127.25.214.195:35561)
0807 05:01:25.678167 (+ 2137us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.678224 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.679355 (+ 1131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.680190 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.680199 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.680605 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:01:25.681311 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.681330 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.685550 (+ 4220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.685553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.687046 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.687059 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.687859 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.687863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.688117 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.688831 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:01:25.688853 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:01:25.690623 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:01:25.692686 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:01:25.692692 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:01:25.692712 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:01:25.693049 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:01:25.693364 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:01:25.693367 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:01:25.693369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:01:25.693560 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:01:25.694048 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:01:25.694055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:01:25.694386 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.697272 (+ 2886us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.697680 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1904,"thread_start_us":150,"threads_started":1}
I20260807 05:01:25.700466 12441 heartbeater.cc:347] Connected to a master server at 127.25.214.254:45797
I20260807 05:01:25.700745 12441 heartbeater.cc:464] Registering TS with master...
I20260807 05:01:25.701386 12441 heartbeater.cc:511] Master 127.25.214.254:45797 requested a full tablet report, sending...
I20260807 05:01:25.702746 11743 ts_manager.cc:194] Registered new tserver with Master: 92d535029e0f466099989c3026df8021 (127.25.214.195:43501)
I20260807 05:01:25.703538 11743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:35561
I20260807 05:01:25.707832 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:01:25.720393 12051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.710301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37422 (local address 127.25.214.254:45797)
0807 05:01:25.710429 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.710433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.710998 (+ 565us) server_negotiation.cc:407] Connection header received
0807 05:01:25.711174 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.711178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.711223 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.711271 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:01:25.712282 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.713093 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.714296 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.714644 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.714713 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.716536 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:01:25.716540 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:01:25.716543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:01:25.716570 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:01:25.718356 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.718848 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.718852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.718854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.718941 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:01:25.719225 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:01:25.719228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:01:25.719230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:01:25.719454 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:01:25.719555 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.719917 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.720217 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 05:01:25.724431 11743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:01:25.728986 11743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 07 05:01:25 dist-test-slave-lgr5 krb5kdc[11040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078885, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:01:25.755077 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.743098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:43345 (local address 127.0.0.1:33440)
0807 05:01:25.747196 (+ 4098us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.747255 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.747387 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.748986 (+ 1599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.748989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.749007 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:01:25.749099 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.749105 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.750478 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.750481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.752729 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.752744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.754433 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.754437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.754575 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.754622 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.754741 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.754887 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3907,"thread_start_us":109,"threads_started":1}
I20260807 05:01:25.756686 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.745223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:43613 (local address 127.0.0.1:49560)
0807 05:01:25.748009 (+ 2786us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.748022 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.748138 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.748827 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.748833 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.748858 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:01:25.749012 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.749020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.752637 (+ 3617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.752641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.753827 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.753840 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.756291 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.756295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.756387 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.756410 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.756478 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.756549 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2728,"thread_start_us":103,"threads_started":1}
I20260807 05:01:25.757421 12461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.745666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49560 (local address 127.25.214.193:43613)
0807 05:01:25.747684 (+ 2018us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.747692 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.748142 (+ 450us) server_negotiation.cc:407] Connection header received
0807 05:01:25.748242 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.748248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.748480 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.748639 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:01:25.749154 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.752489 (+ 3335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.755108 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.755923 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.756057 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.756223 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.757167 (+ 944us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.757282 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1904,"thread_start_us":83,"threads_started":1}
I20260807 05:01:25.758620 12458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.744195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.25.214.194:43345)
0807 05:01:25.748397 (+ 4202us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.748407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.748440 (+ 33us) server_negotiation.cc:407] Connection header received
0807 05:01:25.748515 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.748520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.748696 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.748835 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:01:25.749221 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.750332 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.752927 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.753994 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.754130 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.754290 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.758318 (+ 4028us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.758460 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4092,"thread_start_us":146,"threads_started":1}
I20260807 05:01:25.760978 11953 tablet_service.cc:1467] Processing CreateTablet for tablet 4a219948f2704d4a986ec6eb78f103e9 (DEFAULT_TABLE table=test-table [id=36cf651e47734291adf08cb3471b65fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:01:25.761372 12153 tablet_service.cc:1467] Processing CreateTablet for tablet 4a219948f2704d4a986ec6eb78f103e9 (DEFAULT_TABLE table=test-table [id=36cf651e47734291adf08cb3471b65fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:01:25.762137 11953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a219948f2704d4a986ec6eb78f103e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:01:25.762403 12153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a219948f2704d4a986ec6eb78f103e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:01:25.774868 12465 tablet_bootstrap.cc:492] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Bootstrap starting.
I20260807 05:01:25.775723 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.746613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53092 (local address 127.25.214.195:43501)
0807 05:01:25.747876 (+ 1263us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.747886 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.755847 (+ 7961us) server_negotiation.cc:407] Connection header received
0807 05:01:25.756129 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.756137 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.756398 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.756566 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:01:25.756978 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.758135 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.773120 (+ 14985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.774033 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.774179 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.774327 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.774523 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.774642 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1165,"thread_start_us":146,"threads_started":1}
I20260807 05:01:25.776388 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.746430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:43501 (local address 127.0.0.1:53092)
0807 05:01:25.755742 (+ 9312us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.755757 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.755938 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.756758 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.756761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.756780 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:01:25.756856 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.756861 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.771337 (+ 14476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.771341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.772905 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.772923 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.774181 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.774185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.774289 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.774366 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.776155 (+ 1789us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.776250 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9247,"thread_start_us":84,"threads_started":1}
I20260807 05:01:25.779750 12350 tablet_service.cc:1467] Processing CreateTablet for tablet 4a219948f2704d4a986ec6eb78f103e9 (DEFAULT_TABLE table=test-table [id=36cf651e47734291adf08cb3471b65fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:01:25.780992 12350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a219948f2704d4a986ec6eb78f103e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:01:25.785786 12465 tablet_bootstrap.cc:654] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Neither blocks nor log segments found. Creating new log.
I20260807 05:01:25.787333 12465 log.cc:824] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Log is configured to *not* fsync() on all Append() calls
I20260807 05:01:25.788292 12467 tablet_bootstrap.cc:492] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: Bootstrap starting.
I20260807 05:01:25.790578 12469 tablet_bootstrap.cc:492] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Bootstrap starting.
I20260807 05:01:25.791991 12467 tablet_bootstrap.cc:654] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: Neither blocks nor log segments found. Creating new log.
I20260807 05:01:25.792999 12467 log.cc:824] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: Log is configured to *not* fsync() on all Append() calls
I20260807 05:01:25.793337 12469 tablet_bootstrap.cc:654] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Neither blocks nor log segments found. Creating new log.
I20260807 05:01:25.794214 12469 log.cc:824] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Log is configured to *not* fsync() on all Append() calls
I20260807 05:01:25.795445 12465 tablet_bootstrap.cc:492] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: No bootstrap required, opened a new log
I20260807 05:01:25.795686 12465 ts_tablet_manager.cc:1397] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260807 05:01:25.796454 12469 tablet_bootstrap.cc:492] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: No bootstrap required, opened a new log
I20260807 05:01:25.796722 12469 ts_tablet_manager.cc:1397] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:01:25.799767 12465 raft_consensus.cc:348] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.800211 12465 raft_consensus.cc:374] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:01:25.800277 12465 raft_consensus.cc:729] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7663b821c25d4681a4eb350b2c82939c, State: Initialized, Role: FOLLOWER
I20260807 05:01:25.800879 12469 raft_consensus.cc:348] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.801219 12469 raft_consensus.cc:374] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:01:25.801326 12469 raft_consensus.cc:729] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d535029e0f466099989c3026df8021, State: Initialized, Role: FOLLOWER
I20260807 05:01:25.801918 12469 consensus_queue.cc:260] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.802083 12465 consensus_queue.cc:260] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.803321 12469 ts_tablet_manager.cc:1428] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:01:25.803396 12465 ts_tablet_manager.cc:1428] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260807 05:01:25.803804 12257 heartbeater.cc:503] Master 127.25.214.254:45797 was elected leader, sending a full tablet report...
I20260807 05:01:25.805080 12441 heartbeater.cc:503] Master 127.25.214.254:45797 was elected leader, sending a full tablet report...
I20260807 05:01:25.808533 12467 tablet_bootstrap.cc:492] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: No bootstrap required, opened a new log
I20260807 05:01:25.808851 12467 ts_tablet_manager.cc:1397] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
W20260807 05:01:25.814332 12260 tablet.cc:2369] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:01:25.814064 12467 raft_consensus.cc:348] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.815474 12467 raft_consensus.cc:374] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:01:25.815579 12467 raft_consensus.cc:729] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 779a54fd97a043c78fc10bc2eeef5791, State: Initialized, Role: FOLLOWER
I20260807 05:01:25.816164 12467 consensus_queue.cc:260] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.817476 12467 ts_tablet_manager.cc:1428] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 05:01:25.818117 12047 heartbeater.cc:503] Master 127.25.214.254:45797 was elected leader, sending a full tablet report...
W20260807 05:01:25.928164 12443 tablet.cc:2369] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:01:25.951637 12478 raft_consensus.cc:482] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:01:25.951880 12478 raft_consensus.cc:504] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.953156 12478 leader_election.cc:288] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7663b821c25d4681a4eb350b2c82939c (127.25.214.194:43345), 92d535029e0f466099989c3026df8021 (127.25.214.195:43501)
I20260807 05:01:25.958364 12458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.953523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:37609 (local address 127.25.214.194:43345)
0807 05:01:25.953661 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.953666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.953914 (+ 248us) server_negotiation.cc:407] Connection header received
0807 05:01:25.954147 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.954150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.954205 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.954253 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:01:25.954729 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.955460 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.957084 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.957659 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.957743 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.957797 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.958132 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.958211 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 05:01:25.958568 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.954292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:56029 (local address 127.25.214.195:43501)
0807 05:01:25.954416 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.954420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.954665 (+ 245us) server_negotiation.cc:407] Connection header received
0807 05:01:25.954835 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.954838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.954899 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.954947 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:01:25.955334 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.956021 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.957419 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.957962 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.958041 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.958086 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.958383 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.958456 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:01:25.959082 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.953373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:43345 (local address 127.25.214.193:37609)
0807 05:01:25.953817 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.953832 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.954007 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.954424 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.954428 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.954463 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:01:25.954600 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.954608 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.955587 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.955590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.956944 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.956955 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.957899 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.957902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.957991 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.958015 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.958791 (+ 776us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.958911 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":48,"thread_start_us":145,"threads_started":1}
I20260807 05:01:25.959082 12480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.953861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:43501 (local address 127.25.214.193:56029)
0807 05:01:25.954584 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:25.954596 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:01:25.954727 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:01:25.955086 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:01:25.955089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:01:25.955106 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:01:25.955216 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.955221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.956205 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.956208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.957297 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:01:25.957307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.958166 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.958169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:01:25.958253 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.958274 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 05:01:25.958780 (+ 506us) client_negotiation.cc:240] Negotiation successful
0807 05:01:25.958911 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":3,"thread_start_us":93,"threads_started":1}
I20260807 05:01:25.959808 12165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a219948f2704d4a986ec6eb78f103e9" candidate_uuid: "779a54fd97a043c78fc10bc2eeef5791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7663b821c25d4681a4eb350b2c82939c" is_pre_election: true
I20260807 05:01:25.960047 12357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a219948f2704d4a986ec6eb78f103e9" candidate_uuid: "779a54fd97a043c78fc10bc2eeef5791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d535029e0f466099989c3026df8021" is_pre_election: true
I20260807 05:01:25.960176 12165 raft_consensus.cc:2454] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 779a54fd97a043c78fc10bc2eeef5791 in term 0.
I20260807 05:01:25.960325 12357 raft_consensus.cc:2454] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 779a54fd97a043c78fc10bc2eeef5791 in term 0.
I20260807 05:01:25.960759 11886 leader_election.cc:302] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 779a54fd97a043c78fc10bc2eeef5791, 92d535029e0f466099989c3026df8021; no voters:
I20260807 05:01:25.961022 12478 raft_consensus.cc:2781] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:01:25.961107 12478 raft_consensus.cc:482] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:01:25.961149 12478 raft_consensus.cc:3037] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:01:25.962173 12478 raft_consensus.cc:504] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.962481 12478 leader_election.cc:288] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [CANDIDATE]: Term 1 election: Requested vote from peers 7663b821c25d4681a4eb350b2c82939c (127.25.214.194:43345), 92d535029e0f466099989c3026df8021 (127.25.214.195:43501)
I20260807 05:01:25.962857 12357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a219948f2704d4a986ec6eb78f103e9" candidate_uuid: "779a54fd97a043c78fc10bc2eeef5791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d535029e0f466099989c3026df8021"
I20260807 05:01:25.962862 12165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a219948f2704d4a986ec6eb78f103e9" candidate_uuid: "779a54fd97a043c78fc10bc2eeef5791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7663b821c25d4681a4eb350b2c82939c"
I20260807 05:01:25.962976 12357 raft_consensus.cc:3037] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:01:25.963001 12165 raft_consensus.cc:3037] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:01:25.964253 12165 raft_consensus.cc:2454] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 779a54fd97a043c78fc10bc2eeef5791 in term 1.
I20260807 05:01:25.964294 12357 raft_consensus.cc:2454] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 779a54fd97a043c78fc10bc2eeef5791 in term 1.
I20260807 05:01:25.964641 11886 leader_election.cc:302] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 779a54fd97a043c78fc10bc2eeef5791, 92d535029e0f466099989c3026df8021; no voters:
I20260807 05:01:25.964818 12478 raft_consensus.cc:2781] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:01:25.965021 12478 raft_consensus.cc:686] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [term 1 LEADER]: Becoming Leader. State: Replica: 779a54fd97a043c78fc10bc2eeef5791, State: Running, Role: LEADER
I20260807 05:01:25.965363 12478 consensus_queue.cc:237] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } }
I20260807 05:01:25.968430 11741 catalog_manager.cc:5495] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 reported cstate change: term changed from 0 to 1, leader changed from <none> to 779a54fd97a043c78fc10bc2eeef5791 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "779a54fd97a043c78fc10bc2eeef5791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "779a54fd97a043c78fc10bc2eeef5791" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 } health_report { overall_health: UNKNOWN } } }
I20260807 05:01:25.995159 12461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:25.991495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.25.214.193:43613)
0807 05:01:25.991669 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 05:01:25.991674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:01:25.991694 (+ 20us) server_negotiation.cc:407] Connection header received
0807 05:01:25.991839 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:01:25.991842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:01:25.991909 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:01:25.992004 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:01:25.992293 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.992810 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.993658 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:01:25.993880 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:01:25.993969 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:01:25.994285 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:01:25.994742 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:01:25.994856 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 05:01:25.994925 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 05:01:25.994990 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:01:26.001886 12165 raft_consensus.cc:1261] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 1 FOLLOWER]: Refusing update from remote peer 779a54fd97a043c78fc10bc2eeef5791: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:01:26.001878 12357 raft_consensus.cc:1261] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 1 FOLLOWER]: Refusing update from remote peer 779a54fd97a043c78fc10bc2eeef5791: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:01:26.002844 12481 consensus_queue.cc:1035] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d535029e0f466099989c3026df8021" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 43501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:01:26.003151 12478 consensus_queue.cc:1035] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7663b821c25d4681a4eb350b2c82939c" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 05:01:26.007748 12048 tablet.cc:2369] T 4a219948f2704d4a986ec6eb78f103e9 P 779a54fd97a043c78fc10bc2eeef5791: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:01:26.020605 12487 mvcc.cc:205] Tried to move back new op lower bound from 7315779117054046208 to 7315779116916998144. Current Snapshot: MvccSnapshot[applied={T|T < 7315779117054046208 or (T in {7315779117054046208})}]
I20260807 05:01:26.020955 12484 mvcc.cc:205] Tried to move back new op lower bound from 7315779117054046208 to 7315779116916998144. Current Snapshot: MvccSnapshot[applied={T|T < 7315779117054046208}]
I20260807 05:01:26.027752 12486 mvcc.cc:205] Tried to move back new op lower bound from 7315779117054046208 to 7315779116916998144. Current Snapshot: MvccSnapshot[applied={T|T < 7315779117054046208}]
I20260807 05:01:26.032567 11741 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:01:26.032738 11741 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:01:26.035682 11741 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0bbbce9c4e8643569910157e706a88b5: Sending DeleteTablet for 3 replicas of tablet 4a219948f2704d4a986ec6eb78f103e9
I20260807 05:01:26.037103 12153 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a219948f2704d4a986ec6eb78f103e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:01:26 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:33440
I20260807 05:01:26.037653 11953 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a219948f2704d4a986ec6eb78f103e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:01:26 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:49560
I20260807 05:01:26.038316 12350 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a219948f2704d4a986ec6eb78f103e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:01:26 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:53092
I20260807 05:01:26.039746 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 11857
I20260807 05:01:26.056613 12500 tablet_replica.cc:330] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: stopping tablet replica
I20260807 05:01:26.057091 12500 raft_consensus.cc:2229] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:01:26.057545 12500 raft_consensus.cc:2258] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:01:26.063901 12504 tablet_replica.cc:330] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: stopping tablet replica
I20260807 05:01:26.063998 12500 ts_tablet_manager.cc:1905] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:01:26.064437 12504 raft_consensus.cc:2229] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:01:26.064888 12504 raft_consensus.cc:2258] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:01:26.067206 12500 ts_tablet_manager.cc:1918] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:01:26.067384 12500 log.cc:1196] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/4a219948f2704d4a986ec6eb78f103e9
I20260807 05:01:26.067800 12500 ts_tablet_manager.cc:1939] T 4a219948f2704d4a986ec6eb78f103e9 P 7663b821c25d4681a4eb350b2c82939c: Deleting consensus metadata
I20260807 05:01:26.069557 11720 catalog_manager.cc:4841] TS 7663b821c25d4681a4eb350b2c82939c (127.25.214.194:43345): tablet 4a219948f2704d4a986ec6eb78f103e9 (table test-table [id=36cf651e47734291adf08cb3471b65fc]) successfully deleted
W20260807 05:01:26.070258 11723 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:43613 (error 108)
I20260807 05:01:26.070585 12504 ts_tablet_manager.cc:1905] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:01:26.071943 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:01:26.071600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:43613 (local address 127.0.0.1:49576)
0807 05:01:26.071774 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 05:01:26.071852 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:43613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260807 05:01:26.072299 11723 catalog_manager.cc:4584] TS 779a54fd97a043c78fc10bc2eeef5791 (127.25.214.193:43613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a219948f2704d4a986ec6eb78f103e9: Network error: Client connection negotiation failed: client connection to 127.25.214.193:43613: connect: Connection refused (error 111)
I20260807 05:01:26.072705 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 12054
I20260807 05:01:26.084823 12504 ts_tablet_manager.cc:1918] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:01:26.085071 12504 log.cc:1196] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/4a219948f2704d4a986ec6eb78f103e9
I20260807 05:01:26.085525 12504 ts_tablet_manager.cc:1939] T 4a219948f2704d4a986ec6eb78f103e9 P 92d535029e0f466099989c3026df8021: Deleting consensus metadata
I20260807 05:01:26.088421 11720 catalog_manager.cc:4841] TS 92d535029e0f466099989c3026df8021 (127.25.214.195:43501): tablet 4a219948f2704d4a986ec6eb78f103e9 (table test-table [id=36cf651e47734291adf08cb3471b65fc]) successfully deleted
I20260807 05:01:26.093429 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 12267
I20260807 05:01:26.115741 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 11689
I20260807 05:01:26.131353 26459 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 05:01:26.476261 26459 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 05:01:26.476404 26459 mini_ranger.cc:66] Stopping Ranger...
I20260807 05:01:26.821193 26459 mini_ranger.cc:68] Stopped Ranger
2026-08-07 05:01:26.821 UTC [11081] LOG: received smart shutdown request
2026-08-07 05:01:26.825 UTC [11081] LOG: background worker "logical replication launcher" (PID 11095) exited with exit code 1
2026-08-07 05:01:26.825 UTC [11085] LOG: shutting down
2026-08-07 05:01:26.982 UTC [11081] LOG: database system is shut down
2026-08-07T05:01:26Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48169 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:01:27 dist-test-slave-lgr5 krb5kdc[12520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:01:27 dist-test-slave-lgr5 krb5kdc[12520](info): set up 2 sockets
Aug 07 05:01:27 dist-test-slave-lgr5 krb5kdc[12520](info): commencing operation
krb5kdc: starting...
W20260807 05:01:28.235327 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:01:28 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:01:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:01:28Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/rangeradmin_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/rangeradmin_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/rangerlookup_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/rangerlookup_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
I20260807 05:01:28.408985 26459 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZKK2Ci/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/postgres -l logfile start
2026-08-07 05:01:30.789 UTC [12560] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 05:01:30.789 UTC [12560] LOG: listening on IPv4 address "127.25.214.212", port 33115
2026-08-07 05:01:30.793 UTC [12560] LOG: listening on Unix socket "/tmp/.s.PGSQL.33115"
2026-08-07 05:01:30.812 UTC [12565] LOG: database system was shut down at 2026-08-07 05:01:29 UTC
2026-08-07 05:01:30.815 UTC [12560] LOG: database system is ready to accept connections
I20260807 05:01:31.904486 26459 mini_postgres.cc:96] Postgres bound to 33115
2026-08-07 05:01:31.911 UTC [12576] FATAL: database "slave" does not exist
127.25.214.212:33115 - accepting connections
I20260807 05:01:31.912209 26459 mini_ranger.cc:161] Starting Ranger...
I20260807 05:01:31.927891 26459 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 05:01:32.379580 26459 mini_ranger.cc:87] Created ranger Postgres database
I20260807 05:01:32.379666 26459 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-admin
2026-08-07 05:01:32,652 [I] DB FLAVOR :POSTGRES
2026-08-07 05:01:32,653 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 05:01:32,653 [I] Checking connection..
2026-08-07 05:01:32,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 05:01:32,889 [I] Checking connection passed.
2026-08-07 05:01:32,889 [I] --------- Verifying version history table ---------
2026-08-07 05:01:32,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 05:01:33,162 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 05:01:33,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 05:01:33,433 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 05:01:33,433 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 05:01:33,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 05:01:33.690 UTC [12672] WARNING: there is no transaction in progress
2026-08-07 05:01:33,699 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 05:01:33,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 05:01:33,948 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 05:01:33,948 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 05:01:33,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 05:01:34,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 05:01:34,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-07 05:01:34,726 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 05:01:34,983 [I] Table x_portal_user does not exist in database ranger
2026-08-07 05:01:34,984 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 05:01:35,239 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 05:01:35,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 05:01:35,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 05:01:35,755 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 05:01:35,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 05:01:36.729 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.745 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.762 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.777 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.793 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.810 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.869 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.876 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.891 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.901 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.912 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.927 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.937 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.944 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.951 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:36.958 UTC [12820] WARNING: there is no transaction in progress
2026-08-07 05:01:37,616 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 05:01:37,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 05:01:37,871 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 05:01:37,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 05:01:38,129 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 05:01:38,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 05:01:38,390 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 05:01:38,390 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 05:01:38,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 05:01:38,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-07 05:01:39,153 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 05:01:39,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 05:01:39,407 [I] DB_PATCHES have already been applied
I20260807 05:01:39.413817 26459 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZKK2Ci/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 05:01:39.413882 26459 mini_ranger.cc:193] Using host: 127.25.214.212
I20260807 05:01:39.418236 26459 mini_ranger.cc:227] Ranger admin URL: http://127.25.214.212:46499
Aug 07, 2026 5:01:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 5:01:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 5:01:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 5:01:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 5:01:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 5:01:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 5:01:40 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 05:01:40.600188 26459 mini_ranger.cc:160] Time spent starting Ranger: real 8.688s user 0.003s sys 0.008s
Aug 07, 2026 5:01:59 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 5:01:59 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 5:01:59 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 5:01:59 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 5:02:00 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 05:02:01.543639 26459 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.214.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.214.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/rangerkms_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.214.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/rangerkms_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.214.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.214.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.214.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/HTTP_127.25.214.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 05:02:01 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078921, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 05:02:01.629949 26459 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 05:02:01.641106 26459 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 05:02:02.433924 26459 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 05:02:02.433998 26459 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms
I20260807 05:02:02.434016 26459 mini_ranger_kms.cc:227] Using postgres at 127.25.214.212:33115
2026-08-07 05:02:02,609 [I] DB FLAVOR :POSTGRES
2026-08-07 05:02:02,610 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 05:02:02,610 [I] Checking connection
2026-08-07 05:02:02,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 05:02:02,873 [I] connection success
2026-08-07 05:02:02,873 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 05:02:02,873 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 05:02:02,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 05:02:03,106 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 05:02:03,107 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 05:02:03,107 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 05:02:03,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.214.212:33115/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 05:02:03,383 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 05:02:03.827833 26459 mini_ranger_kms.cc:310] Created kms service
I20260807 05:02:04.020035 26459 mini_ranger_kms.cc:326] Created kudu user
I20260807 05:02:04.062660 26459 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 05:02:04 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078921, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:04.469934 26459 mini_ranger_kms.cc:384] Added ranger policy
I20260807 05:02:04.470110 26459 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZKK2Ci/build/debug/bin/postgresql.jar:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZKK2Ci/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 05:02:04.470140 26459 mini_ranger_kms.cc:240] Using host: 127.25.214.212
I20260807 05:02:04.474694 26459 mini_ranger_kms.cc:276] Ranger KMS PID: 13070
I20260807 05:02:04.474789 26459 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.214.212:35361
Aug 07, 2026 5:02:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 5:02:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 5:02:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 5:02:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 5:02:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 5:02:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 05:02:06 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786078926, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.214.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:07.005973 26459 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.376s user 0.012s sys 0.150s
I20260807 05:02:07.006093 26459 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 05:02:07.006157 26459 mini_ranger_kms.cc:401] 127.25.214.212:35361/kms/v1/keys
Aug 07 05:02:07 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078926, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.214.212@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
Aug 07 05:02:07 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078926, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.214.212@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
Aug 07 05:02:09 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:02:09.898483 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40677
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:40677
--ranger_config_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:10.018726 13140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:10.019009 13140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:10.019048 13140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:10.023067 13140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:10.023138 13140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:10.023156 13140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:10.023170 13140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:10.023185 13140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:10.028832 13140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.214.212:35361/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:40677
--ranger_config_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:10.029942 13140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:10.030977 13140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:10.039851 13148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:10.039903 13140 server_base.cc:1034] running on GCE node
W20260807 05:02:10.039853 13150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:10.040210 13152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:10.040915 13140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:10.042382 13140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:10.043581 13140 hybrid_clock.cc:648] HybridClock initialized: now 1786078930043551 us; error 40 us; skew 500 ppm
Aug 07 05:02:10 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078930, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:10.046792 13140 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:10.047748 13140 webserver.cc:460] Webserver started at http://127.25.214.254:37587/ using document root <none> and password file <none>
I20260807 05:02:10.048384 13140 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:10.048444 13140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:10.048648 13140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:02:10 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078930, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:10.096138 13140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "e81db31640d54b758a3ee7ab972dcb23"
format_stamp: "Formatted at 2026-08-07 05:02:10 on dist-test-slave-lgr5"
server_key: "4e5c6225ff23113cd3b14cf29306997b"
server_key_iv: "e5c8525660b0a719e7eed067a73dcdb0"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:10.096853 13140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "e81db31640d54b758a3ee7ab972dcb23"
format_stamp: "Formatted at 2026-08-07 05:02:10 on dist-test-slave-lgr5"
server_key: "4e5c6225ff23113cd3b14cf29306997b"
server_key_iv: "e5c8525660b0a719e7eed067a73dcdb0"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:10.101063 13140 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:02:10.116150 13165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:10.117537 13140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:02:10.117661 13140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "e81db31640d54b758a3ee7ab972dcb23"
format_stamp: "Formatted at 2026-08-07 05:02:10 on dist-test-slave-lgr5"
server_key: "4e5c6225ff23113cd3b14cf29306997b"
server_key_iv: "e5c8525660b0a719e7eed067a73dcdb0"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:10.117800 13140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:10.143324 13140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:10.146529 13140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:10.146716 13140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:10.154506 13140 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:40677
I20260807 05:02:10.154523 13240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:40677 every 8 connection(s)
I20260807 05:02:10.155576 13140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:10.156713 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 13140
I20260807 05:02:10.156844 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:02:10.157171 26459 external_mini_cluster.cc:1428] Setting key 6476480fd5093b16f99b66d8b92cb351
I20260807 05:02:10.159183 13241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:10.165797 13241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Bootstrap starting.
Aug 07 05:02:10 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:10.168442 13241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:10.169278 13241 log.cc:824] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:10.171603 13241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: No bootstrap required, opened a new log
I20260807 05:02:10.174734 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:10.158693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48976 (local address 127.25.214.254:40677)
0807 05:02:10.159181 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:10.159200 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:10.159244 (+ 44us) server_negotiation.cc:407] Connection header received
0807 05:02:10.160142 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:10.160167 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:10.160600 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:10.161901 (+ 1301us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:10.162325 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:10.163818 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:10.165126 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:10.165818 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:10.165961 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:10.169042 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:10.169050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:10.169068 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:10.169101 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:10.171568 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:10.172059 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:10.172065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:10.172071 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:10.172236 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:10.172524 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:10.172527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:10.172529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:10.173033 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:10.173217 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:10.173514 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 05:02:10.173802 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":148,"threads_started":1}
I20260807 05:02:10.175477 13241 raft_consensus.cc:348] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:10.175750 13241 raft_consensus.cc:374] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:10.175858 13241 raft_consensus.cc:729] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81db31640d54b758a3ee7ab972dcb23, State: Initialized, Role: FOLLOWER
I20260807 05:02:10.176440 13241 consensus_queue.cc:260] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:10.176599 13241 raft_consensus.cc:388] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:10.176684 13241 raft_consensus.cc:482] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:10.176779 13241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:10.177773 13241 raft_consensus.cc:504] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:10.178133 13241 leader_election.cc:302] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e81db31640d54b758a3ee7ab972dcb23; no voters:
I20260807 05:02:10.178448 13241 leader_election.cc:288] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:02:10.178539 13249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:10.178714 13249 raft_consensus.cc:686] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 LEADER]: Becoming Leader. State: Replica: e81db31640d54b758a3ee7ab972dcb23, State: Running, Role: LEADER
I20260807 05:02:10.179057 13249 consensus_queue.cc:237] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:10.179721 13241 sys_catalog.cc:564] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:10.180723 13252 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e81db31640d54b758a3ee7ab972dcb23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } } }
I20260807 05:02:10.180928 13252 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:10.181217 13252 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e81db31640d54b758a3ee7ab972dcb23. Latest consensus state: current_term: 1 leader_uuid: "e81db31640d54b758a3ee7ab972dcb23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } } }
I20260807 05:02:10.181406 13252 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:10.182265 13265 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:10.182502 13241 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 05:02:10.189157 13265 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:10.197538 13265 catalog_manager.cc:1347] Generated new cluster ID: c24b83aec29e48e3b60cd74a4877633c
I20260807 05:02:10.197661 13265 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:10.208461 13265 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:02:10.209846 13265 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:10.230223 13265 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Generated new TSK 0
I20260807 05:02:10.231946 13265 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:02:10.953486 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40677
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:11.119956 13308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:11.120347 13308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:11.120414 13308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:11.126199 13308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:11.126277 13308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:11.126363 13308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:02:11.134286 13308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.214.212:35361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:11.135784 13308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:11.137244 13308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:11.149078 13322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:11.149055 13324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:11.149055 13321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:11.149451 13308 server_base.cc:1034] running on GCE node
I20260807 05:02:11.149942 13308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:11.150576 13308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:11.151733 13308 hybrid_clock.cc:648] HybridClock initialized: now 1786078931151697 us; error 52 us; skew 500 ppm
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:11.154712 13308 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:02:11.155853 13308 webserver.cc:460] Webserver started at http://127.25.214.193:32785/ using document root <none> and password file <none>
I20260807 05:02:11.156543 13308 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:11.156599 13308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:11.156762 13308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:11.172294 13308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "3d8a433b9a644c2e94544a794ee7f019"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "1bbcfe8bc78ebe3f8c19a5d9ae7ce8a9"
server_key_iv: "b28e38fa193c060c046f2181dfdab062"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.173099 13308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "3d8a433b9a644c2e94544a794ee7f019"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "1bbcfe8bc78ebe3f8c19a5d9ae7ce8a9"
server_key_iv: "b28e38fa193c060c046f2181dfdab062"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.192885 13308 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.004s sys 0.000s
I20260807 05:02:11.212533 13335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:11.214589 13308 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:02:11.214928 13308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "3d8a433b9a644c2e94544a794ee7f019"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "1bbcfe8bc78ebe3f8c19a5d9ae7ce8a9"
server_key_iv: "b28e38fa193c060c046f2181dfdab062"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.215133 13308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:11.242777 13308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:11.245663 13308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:11.245841 13308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:11.246454 13308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:11.247334 13308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:11.247393 13308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:11.247449 13308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:11.247498 13308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:11.257064 13308 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:40195
I20260807 05:02:11.257776 13506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:40195 every 8 connection(s)
I20260807 05:02:11.258208 13308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:02:11.265538 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 13308
I20260807 05:02:11.265664 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:02:11.266006 26459 external_mini_cluster.cc:1428] Setting key 3196d4a1eda49415a6338ff38456c283
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:11.273910 13513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:11.260208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:37755 (local address 127.25.214.254:40677)
0807 05:02:11.260486 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:11.260491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:11.261249 (+ 758us) server_negotiation.cc:407] Connection header received
0807 05:02:11.262237 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:11.262241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:11.262301 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:11.262384 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:11.263486 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.264041 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.265180 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.265477 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.265578 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:11.268860 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:11.268865 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:11.268868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:11.268896 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:11.270752 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:11.271780 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:11.271784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:11.271786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:11.271888 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:11.272382 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:11.272386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:11.272388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:11.272657 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:11.272738 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:11.273546 (+ 808us) server_negotiation.cc:299] Negotiation successful
0807 05:02:11.273704 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":71,"threads_started":1}
I20260807 05:02:11.276132 13514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:11.260608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40677 (local address 127.25.214.193:37755)
0807 05:02:11.261090 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:11.261143 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:11.262032 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:11.262567 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:11.262573 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:11.262850 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:11.263333 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:11.263346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.264177 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.264180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:11.265061 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:11.265071 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.265778 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.265782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:11.266000 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:11.266789 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:11.266812 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:11.268643 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:11.270914 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:11.270921 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:11.270941 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:11.271653 (+ 712us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:11.272014 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:11.272017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:11.272019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:11.272258 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:11.272828 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:11.272836 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:11.273219 (+ 383us) client_negotiation.cc:769] Sending connection context
0807 05:02:11.274448 (+ 1229us) client_negotiation.cc:240] Negotiation successful
0807 05:02:11.274878 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":122,"threads_started":1}
I20260807 05:02:11.278441 13508 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40677
I20260807 05:02:11.278769 13508 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:02:11.279492 13508 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:11.281491 13191 ts_manager.cc:194] Registered new tserver with Master: 3d8a433b9a644c2e94544a794ee7f019 (127.25.214.193:40195)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 05:02:11.283082 13191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:37755
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:02:11.301432 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40677
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:11.470148 13522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:11.470623 13522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:11.470763 13522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:11.476794 13522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:11.476893 13522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:11.476989 13522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:02:11.485198 13522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.214.212:35361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:11.486714 13522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:11.488197 13522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:11.499596 13531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:11.499787 13522 server_base.cc:1034] running on GCE node
W20260807 05:02:11.499596 13530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:11.499637 13535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:11.500444 13522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:11.501133 13522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:11.502291 13522 hybrid_clock.cc:648] HybridClock initialized: now 1786078931502253 us; error 58 us; skew 500 ppm
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:11.505434 13522 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:02:11.506750 13522 webserver.cc:460] Webserver started at http://127.25.214.194:46785/ using document root <none> and password file <none>
I20260807 05:02:11.507553 13522 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:11.507661 13522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:11.508002 13522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:11.531183 13522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "00d2ceae081146308e5b5d9b4135e898"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "d6fa9da32b875312f7a48f53e96518a3"
server_key_iv: "e41dee19aaa7f19d9c112133e80ac529"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.532172 13522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "00d2ceae081146308e5b5d9b4135e898"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "d6fa9da32b875312f7a48f53e96518a3"
server_key_iv: "e41dee19aaa7f19d9c112133e80ac529"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.542318 13522 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.004s sys 0.000s
I20260807 05:02:11.568833 13546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:11.570858 13522 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260807 05:02:11.571034 13522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "00d2ceae081146308e5b5d9b4135e898"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "d6fa9da32b875312f7a48f53e96518a3"
server_key_iv: "e41dee19aaa7f19d9c112133e80ac529"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.571208 13522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:11.605125 13522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:11.608695 13522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:11.608973 13522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:11.609776 13522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:11.610935 13522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:11.611047 13522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:11.611141 13522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:11.611200 13522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:11.625592 13522 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:37809
I20260807 05:02:11.626940 13522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:02:11.627611 13716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:37809 every 8 connection(s)
I20260807 05:02:11.637010 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 13522
I20260807 05:02:11.637152 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:02:11.637480 26459 external_mini_cluster.cc:1428] Setting key fcd0b78901ad7938dd8ea579c34f3289
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:11.650439 13513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:11.630108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:40361 (local address 127.25.214.254:40677)
0807 05:02:11.631711 (+ 1603us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:11.631716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:11.632779 (+ 1063us) server_negotiation.cc:407] Connection header received
0807 05:02:11.634131 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:11.634135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:11.634192 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:11.634244 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:11.635937 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.636765 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.642254 (+ 5489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.642610 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.642708 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:11.646044 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:11.646048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:11.646051 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:11.646081 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:11.647713 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:11.648410 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:11.648414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:11.648417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:11.648506 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:11.648946 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:11.648950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:11.648951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:11.649176 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:11.649258 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:11.650089 (+ 831us) server_negotiation.cc:299] Negotiation successful
0807 05:02:11.650229 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1492}
I20260807 05:02:11.652953 13722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:11.630589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40677 (local address 127.25.214.194:40361)
0807 05:02:11.632590 (+ 2001us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:11.632649 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:11.633852 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:11.634665 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:11.634673 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:11.635058 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:11.635748 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:11.635768 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.636942 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.636946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:11.642067 (+ 5121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:11.642087 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:11.642959 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:11.642963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:11.643191 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:11.643853 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:11.643877 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:11.645811 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:11.647851 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:11.647858 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:11.647877 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:11.648289 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:11.648618 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:11.648620 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:11.648622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:11.648809 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:11.649332 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:11.649339 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:11.649771 (+ 432us) client_negotiation.cc:769] Sending connection context
0807 05:02:11.651426 (+ 1655us) client_negotiation.cc:240] Negotiation successful
0807 05:02:11.651795 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1776,"thread_start_us":178,"threads_started":1}
I20260807 05:02:11.654573 13719 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40677
I20260807 05:02:11.654825 13719 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:11.655467 13719 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:11.656733 13191 ts_manager.cc:194] Registered new tserver with Master: 00d2ceae081146308e5b5d9b4135e898 (127.25.214.194:37809)
I20260807 05:02:11.657518 13191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:40361
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:02:11.703826 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40677
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
W20260807 05:02:11.888482 13725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:11.888989 13725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:11.889261 13725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:11.895578 13725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:11.895718 13725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:11.895834 13725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:02:11.903788 13725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.214.212:35361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:11.905473 13725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:11.906879 13725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:11.922842 13734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:11.923352 13725 server_base.cc:1034] running on GCE node
W20260807 05:02:11.923130 13732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:11.923985 13731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:11.924628 13725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:11.925438 13725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:11.926589 13725 hybrid_clock.cc:648] HybridClock initialized: now 1786078931926528 us; error 76 us; skew 500 ppm
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:11.930416 13725 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:02:11.931720 13725 webserver.cc:460] Webserver started at http://127.25.214.195:45731/ using document root <none> and password file <none>
I20260807 05:02:11.932612 13725 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:11.932773 13725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:11.933089 13725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 05:02:11 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:11.952554 13725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "18acc1e3062940819403fdb790c4c78d"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "e0ad25ba5c01dc90089077be1550de4e"
server_key_iv: "689fdb96ac679d54031fdf19de52e579"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.953392 13725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "18acc1e3062940819403fdb790c4c78d"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "e0ad25ba5c01dc90089077be1550de4e"
server_key_iv: "689fdb96ac679d54031fdf19de52e579"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:11.965833 13725 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.006s sys 0.000s
I20260807 05:02:12.002300 13745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.004367 13725 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.005s
I20260807 05:02:12.004539 13725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "18acc1e3062940819403fdb790c4c78d"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "e0ad25ba5c01dc90089077be1550de4e"
server_key_iv: "689fdb96ac679d54031fdf19de52e579"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:12.004711 13725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:12.024976 13725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:12.029349 13725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:12.029685 13725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:12.030560 13725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:12.031852 13725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:12.031975 13725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.032127 13725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:12.032207 13725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.044111 13725 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:41799
I20260807 05:02:12.045552 13725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:02:12.050043 13914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:41799 every 8 connection(s)
I20260807 05:02:12.052175 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 13725
I20260807 05:02:12.052314 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:02:12.052640 26459 external_mini_cluster.cc:1428] Setting key ca870f90762bf6ba22ba5d943f7af464
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:12.072387 13513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:12.055744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:49991 (local address 127.25.214.254:40677)
0807 05:02:12.055876 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:12.055881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:12.055992 (+ 111us) server_negotiation.cc:407] Connection header received
0807 05:02:12.057353 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:12.057357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:12.057420 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:12.057470 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:12.059380 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.060290 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.062147 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.062504 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.062581 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:12.067770 (+ 5189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:12.067775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:12.067777 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:12.067811 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:12.069585 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:12.070298 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:12.070302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:12.070304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:12.070393 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:12.070932 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:12.070935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:12.070937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:12.071189 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:12.071260 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:12.072015 (+ 755us) server_negotiation.cc:299] Negotiation successful
0807 05:02:12.072204 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:02:12.074441 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:12.054459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40677 (local address 127.25.214.195:49991)
0807 05:02:12.055701 (+ 1242us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:12.055772 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:12.057071 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:12.057963 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:12.057973 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:12.058368 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:12.059162 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:12.059188 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.060472 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.060475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:12.061970 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:12.061984 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.062821 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.062825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:12.063056 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:12.063814 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:12.063837 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:12.067556 (+ 3719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:12.069758 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:12.069765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:12.069787 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:12.070180 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:12.070496 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:12.070499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:12.070501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:12.070819 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:12.071346 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:12.071354 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:12.071722 (+ 368us) client_negotiation.cc:769] Sending connection context
0807 05:02:12.072898 (+ 1176us) client_negotiation.cc:240] Negotiation successful
0807 05:02:12.073303 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":188,"threads_started":1}
I20260807 05:02:12.076225 13917 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40677
I20260807 05:02:12.076498 13917 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.077157 13917 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:12.080519 13191 ts_manager.cc:194] Registered new tserver with Master: 18acc1e3062940819403fdb790c4c78d (127.25.214.195:41799)
I20260807 05:02:12.081362 13191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:49991
I20260807 05:02:12.092020 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:02:12.092958 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 13308
I20260807 05:02:12.178263 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 13522
I20260807 05:02:12.196175 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 13725
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078931, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:12.222443 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 13140
I20260807 05:02:12.241947 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40677
--webserver_interface=127.25.214.254
--webserver_port=37587
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:40677
--ranger_config_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:12.357206 13921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:12.357506 13921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:12.357546 13921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:12.361739 13921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:12.361828 13921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:12.361848 13921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:12.361863 13921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:12.361877 13921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:12.367674 13921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:40677
--ranger_config_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:12.368949 13921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:12.370024 13921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:12.378443 13926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:12.378499 13927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:12.378475 13921 server_base.cc:1034] running on GCE node
W20260807 05:02:12.378736 13929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:12.379273 13921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:12.380427 13921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:12.381579 13921 hybrid_clock.cc:648] HybridClock initialized: now 1786078932381561 us; error 29 us; skew 500 ppm
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:12.384393 13921 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:12.385324 13921 webserver.cc:460] Webserver started at http://127.25.214.254:37587/ using document root <none> and password file <none>
I20260807 05:02:12.385852 13921 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:12.385922 13921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:12.424279 13921 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:02:12.426700 13937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.428117 13921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:12.428272 13921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "e81db31640d54b758a3ee7ab972dcb23"
format_stamp: "Formatted at 2026-08-07 05:02:10 on dist-test-slave-lgr5"
server_key: "4e5c6225ff23113cd3b14cf29306997b"
server_key_iv: "e5c8525660b0a719e7eed067a73dcdb0"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:12.428887 13921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:12.442046 13921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:12.444787 13921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:12.444964 13921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:12.452205 13921 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:40677
I20260807 05:02:12.452229 14020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:40677 every 8 connection(s)
I20260807 05:02:12.453310 13921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:12.457751 14021 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:02:12.459448 14021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Bootstrap starting.
I20260807 05:02:12.459769 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 13921
I20260807 05:02:12.460227 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:40195
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:40677
--webserver_port=32785
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:12.476961 14021 log.cc:824] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:12.483672 14021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:02:12.484037 14021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Bootstrap complete.
I20260807 05:02:12.488056 14021 raft_consensus.cc:348] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:12.488487 14021 raft_consensus.cc:729] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81db31640d54b758a3ee7ab972dcb23, State: Initialized, Role: FOLLOWER
I20260807 05:02:12.488932 14021 consensus_queue.cc:260] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:12.489050 14021 raft_consensus.cc:388] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:12.489114 14021 raft_consensus.cc:482] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:12.489207 14021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 1 FOLLOWER]: Advancing to term 2
I20260807 05:02:12.491010 14021 raft_consensus.cc:504] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:12.491312 14021 leader_election.cc:302] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e81db31640d54b758a3ee7ab972dcb23; no voters:
I20260807 05:02:12.491603 14021 leader_election.cc:288] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 05:02:12.491706 14029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 05:02:12.491943 14029 raft_consensus.cc:686] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [term 2 LEADER]: Becoming Leader. State: Replica: e81db31640d54b758a3ee7ab972dcb23, State: Running, Role: LEADER
I20260807 05:02:12.492321 14029 consensus_queue.cc:237] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } }
I20260807 05:02:12.492844 14021 sys_catalog.cc:564] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:12.493633 14030 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e81db31640d54b758a3ee7ab972dcb23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } } }
I20260807 05:02:12.493765 14030 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:12.494055 14031 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e81db31640d54b758a3ee7ab972dcb23. Latest consensus state: current_term: 2 leader_uuid: "e81db31640d54b758a3ee7ab972dcb23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e81db31640d54b758a3ee7ab972dcb23" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40677 } } }
I20260807 05:02:12.494194 14031 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:12.494640 14035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:12.497893 14035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:12.498425 14021 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 05:02:12.498550 14035 catalog_manager.cc:1259] Loaded cluster ID: c24b83aec29e48e3b60cd74a4877633c
I20260807 05:02:12.498669 14035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:12.501083 14035 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:12.501724 14035 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Loaded TSK: 0
I20260807 05:02:12.502905 14035 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 05:02:12.583405 14023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:12.583702 14023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:12.583765 14023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:12.588739 14023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:12.588804 14023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:12.588886 14023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:02:12.595187 14023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:40195
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=32785
--tserver_master_addrs=127.25.214.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:12.596475 14023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:12.597615 14023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:12.607599 14082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:12.607685 14085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:12.607884 14079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:12.608978 14023 server_base.cc:1034] running on GCE node
I20260807 05:02:12.609645 14023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:12.610496 14023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:12.614880 14023 hybrid_clock.cc:648] HybridClock initialized: now 1786078932614807 us; error 102 us; skew 500 ppm
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:12.618317 14023 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:02:12.619360 14023 webserver.cc:460] Webserver started at http://127.25.214.193:32785/ using document root <none> and password file <none>
I20260807 05:02:12.620007 14023 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:12.620182 14023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:12.640942 14023 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 05:02:12.645294 14098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.647226 14023 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260807 05:02:12.647512 14023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "3d8a433b9a644c2e94544a794ee7f019"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "1bbcfe8bc78ebe3f8c19a5d9ae7ce8a9"
server_key_iv: "b28e38fa193c060c046f2181dfdab062"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:12.648476 14023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:12.661940 14023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:12.669220 14023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:12.669668 14023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:12.670661 14023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:12.671656 14023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:12.671720 14023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.671809 14023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:12.671850 14023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.683926 14023 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:40195
I20260807 05:02:12.684249 14271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:40195 every 8 connection(s)
I20260807 05:02:12.685648 14023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:02:12.690510 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 14023
I20260807 05:02:12.691041 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:37809
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:40677
--webserver_port=46785
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:12.720331 14279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:12.688466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40677 (local address 127.25.214.193:41305)
0807 05:02:12.689649 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:12.689721 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:12.690878 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:12.693062 (+ 2184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:12.693072 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:12.693450 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:12.694381 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:12.694405 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.698292 (+ 3887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.698296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:12.709525 (+ 11229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:12.709547 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.710947 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.710953 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:12.711175 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:12.712268 (+ 1093us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:12.712291 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:12.714136 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:12.716718 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:12.716724 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:12.716740 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:12.717081 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:12.717497 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:12.717500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:12.717502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:12.717669 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:12.718470 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:12.718477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:12.718794 (+ 317us) client_negotiation.cc:769] Sending connection context
0807 05:02:12.718983 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 05:02:12.719312 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"thread_start_us":149,"threads_started":1}
I20260807 05:02:12.722451 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:12.688351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:41305 (local address 127.25.214.254:40677)
0807 05:02:12.691522 (+ 3171us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:12.691547 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:12.691597 (+ 50us) server_negotiation.cc:407] Connection header received
0807 05:02:12.691950 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:12.691968 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:12.692479 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:12.694615 (+ 2136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:12.694966 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.697861 (+ 2895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.709762 (+ 11901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.710528 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.710693 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:12.714387 (+ 3694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:12.714394 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:12.714412 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:12.714445 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:12.716580 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:12.717232 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:12.717238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:12.717244 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:12.717390 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:12.717778 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:12.717782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:12.717783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:12.718279 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:12.718403 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:12.721296 (+ 2893us) server_negotiation.cc:299] Negotiation successful
0807 05:02:12.721590 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2966,"thread_start_us":145,"threads_started":1}
I20260807 05:02:12.725279 14274 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40677
I20260807 05:02:12.725517 14274 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.726079 14274 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
W20260807 05:02:12.728411 14274 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:40677 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 05:02:12.728556 14274 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.728735 14274 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:12.729699 14274 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.729877 14274 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
W20260807 05:02:12.730736 14274 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:02:12.839596 14284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:12.839826 14284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:12.839882 14284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:12.843866 14284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:12.843920 14284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:12.843997 14284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:02:12.849450 14284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:37809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=46785
--tserver_master_addrs=127.25.214.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:12.850486 14284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:12.851512 14284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:12.860896 14292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:12.861004 14293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:12.861065 14296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:12.861443 14284 server_base.cc:1034] running on GCE node
I20260807 05:02:12.861908 14284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:12.862648 14284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:12.863907 14284 hybrid_clock.cc:648] HybridClock initialized: now 1786078932863879 us; error 40 us; skew 500 ppm
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:12.867350 14284 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:02:12.868511 14284 webserver.cc:460] Webserver started at http://127.25.214.194:46785/ using document root <none> and password file <none>
I20260807 05:02:12.869243 14284 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:12.869390 14284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:12.892237 14284 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.004s sys 0.000s
I20260807 05:02:12.895900 14307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.897779 14284 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 05:02:12.897954 14284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "00d2ceae081146308e5b5d9b4135e898"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "d6fa9da32b875312f7a48f53e96518a3"
server_key_iv: "e41dee19aaa7f19d9c112133e80ac529"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:12.898874 14284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:12.924746 14284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:12.928197 14284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:12.928472 14284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:12.929308 14284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:12.930491 14284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:12.930601 14284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.930712 14284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:12.930784 14284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:12.943684 14284 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:37809
I20260807 05:02:12.943759 14486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:37809 every 8 connection(s)
I20260807 05:02:12.944801 14284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:02:12.950942 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 14284
I20260807 05:02:12.951467 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.214.212:35361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:41799
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:40677
--webserver_port=45731
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:02:12 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078932, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:12.963811 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:12.948060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:51277 (local address 127.25.214.254:40677)
0807 05:02:12.948244 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:12.948249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:12.949091 (+ 842us) server_negotiation.cc:407] Connection header received
0807 05:02:12.950062 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:12.950065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:12.950128 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:12.950202 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:12.951475 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.952300 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.955664 (+ 3364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.956025 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.956136 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:12.959310 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:12.959315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:12.959318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:12.959349 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:12.961070 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:12.961768 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:12.961772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:12.961774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:12.961886 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:12.962356 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:12.962359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:12.962361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:12.962625 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:12.962722 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:12.963474 (+ 752us) server_negotiation.cc:299] Negotiation successful
0807 05:02:12.963627 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 05:02:12.965612 14490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:12.948455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40677 (local address 127.25.214.194:51277)
0807 05:02:12.948938 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:12.948992 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:12.949863 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:12.950393 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:12.950400 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:12.950681 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:12.951277 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:12.951297 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.952488 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.952491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:12.955508 (+ 3017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:12.955521 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:12.956363 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:12.956367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:12.956583 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:12.957284 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:12.957307 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:12.959086 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:12.961209 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:12.961217 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:12.961237 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:12.961625 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:12.962021 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:12.962024 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:12.962027 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:12.962233 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:12.962798 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:12.962804 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:12.963161 (+ 357us) client_negotiation.cc:769] Sending connection context
0807 05:02:12.964111 (+ 950us) client_negotiation.cc:240] Negotiation successful
0807 05:02:12.964497 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":120,"threads_started":1}
I20260807 05:02:12.967160 14488 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40677
I20260807 05:02:12.967476 14488 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.968194 14488 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
W20260807 05:02:12.970180 14488 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:40677 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 05:02:12.970359 14488 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.970598 14488 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:12.971556 14488 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:12.971731 14488 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
W20260807 05:02:12.972579 14488 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:02:13.115028 14491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:13.115338 14491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:13.115403 14491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:13.119566 14491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:13.119630 14491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:13.119710 14491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:02:13.125396 14491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.214.212:35361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:41799
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=45731
--tserver_master_addrs=127.25.214.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:13.126912 14491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:13.128324 14491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:13.142246 14503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:13.142373 14500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:13.142439 14501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:13.144898 14491 server_base.cc:1034] running on GCE node
I20260807 05:02:13.145462 14491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:13.146385 14491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:13.147637 14491 hybrid_clock.cc:648] HybridClock initialized: now 1786078933147606 us; error 52 us; skew 500 ppm
Aug 07 05:02:13 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078933, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:13.150710 14491 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:02:13.151782 14491 webserver.cc:460] Webserver started at http://127.25.214.195:45731/ using document root <none> and password file <none>
I20260807 05:02:13.152443 14491 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:13.152526 14491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 05:02:13 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078933, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:13.170569 14491 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:02:13.173506 14521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:13.174917 14491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:13.175055 14491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "18acc1e3062940819403fdb790c4c78d"
format_stamp: "Formatted at 2026-08-07 05:02:11 on dist-test-slave-lgr5"
server_key: "e0ad25ba5c01dc90089077be1550de4e"
server_key_iv: "689fdb96ac679d54031fdf19de52e579"
server_key_version: "kuduclusterkey@0"
I20260807 05:02:13.175629 14491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:13.190302 14491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:13.193521 14491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:13.193714 14491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:13.194373 14491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:13.195346 14491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:13.195397 14491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:13.195467 14491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:13.195497 14491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:13.206341 14491 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:41799
I20260807 05:02:13.206372 14690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:41799 every 8 connection(s)
I20260807 05:02:13.207495 14491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:02:13.212009 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 14491
Aug 07 05:02:13 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078933, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:13.223901 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:13.209589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:42061 (local address 127.25.214.254:40677)
0807 05:02:13.209728 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:13.209733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:13.210736 (+ 1003us) server_negotiation.cc:407] Connection header received
0807 05:02:13.212683 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:13.212687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:13.212751 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:13.212808 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:13.214383 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:13.215022 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:13.216563 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:13.216778 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:13.216864 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:13.219364 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:13.219367 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:13.219369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:13.219392 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:13.220870 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:13.221792 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:13.221795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:13.221797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:13.221886 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:13.222287 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:13.222291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:13.222293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:13.222580 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:13.222675 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:13.223523 (+ 848us) server_negotiation.cc:299] Negotiation successful
0807 05:02:13.223661 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 05:02:13.226153 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:13.210059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40677 (local address 127.25.214.195:42061)
0807 05:02:13.210553 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:13.210605 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:13.211665 (+ 1060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:13.213461 (+ 1796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:13.213468 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:13.213732 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:13.214230 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:13.214245 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:13.215162 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:13.215165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:13.216454 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:13.216464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:13.216919 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:13.216923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:13.217108 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:13.217775 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:13.217795 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:13.219205 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:13.221004 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:13.221011 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:13.221027 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:13.221674 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:13.221989 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:13.221992 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:13.221994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:13.222176 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:13.222866 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:13.222873 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:13.223213 (+ 340us) client_negotiation.cc:769] Sending connection context
0807 05:02:13.224657 (+ 1444us) client_negotiation.cc:240] Negotiation successful
0807 05:02:13.225053 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":125,"threads_started":1}
I20260807 05:02:13.227520 14700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:13.212984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48988 (local address 127.25.214.254:40677)
0807 05:02:13.213231 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:13.213241 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:13.215084 (+ 1843us) server_negotiation.cc:407] Connection header received
0807 05:02:13.215160 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:13.215163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:13.215215 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:13.215322 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:13.216272 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:13.217077 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:13.219857 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:13.220231 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:13.220347 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:13.222555 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:13.222559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:13.222562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:13.222621 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:13.225032 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:13.225555 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:13.225559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:13.225561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:13.225656 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:13.225989 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:13.225992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:13.225994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:13.226229 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:13.226437 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:13.227220 (+ 783us) server_negotiation.cc:299] Negotiation successful
0807 05:02:13.227348 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":84,"threads_started":1}
I20260807 05:02:13.227566 14692 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40677
I20260807 05:02:13.227777 14692 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:13.228394 14692 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
W20260807 05:02:13.229887 14692 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:40677 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 05:02:13.230005 14692 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:13.230158 14692 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:13.230922 14692 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:13.231076 14692 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
W20260807 05:02:13.231781 14692 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 05:02:13 dist-test-slave-lgr5 krb5kdc[12520](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786078933, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:13.730978 14274 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:13.731300 14274 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:13.732640 13962 ts_manager.cc:194] Registered new tserver with Master: 3d8a433b9a644c2e94544a794ee7f019 (127.25.214.193:40195)
I20260807 05:02:13.734423 13962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:41305
Aug 07 05:02:13 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078933, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:13.972874 14488 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:13.973438 14488 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:13.975618 13962 ts_manager.cc:194] Registered new tserver with Master: 00d2ceae081146308e5b5d9b4135e898 (127.25.214.194:37809)
I20260807 05:02:13.976465 13962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:51277
Aug 07 05:02:14 dist-test-slave-lgr5 krb5kdc[12520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078933, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for HTTP/127.25.214.212@KRBTEST.COM
I20260807 05:02:14.232038 14692 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:14.232406 14692 heartbeater.cc:511] Master 127.25.214.254:40677 requested a full tablet report, sending...
I20260807 05:02:14.233515 13962 ts_manager.cc:194] Registered new tserver with Master: 18acc1e3062940819403fdb790c4c78d (127.25.214.195:41799)
I20260807 05:02:14.234325 13962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:42061
I20260807 05:02:14.236346 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:02:14.249845 14727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.238059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48994 (local address 127.25.214.254:40677)
0807 05:02:14.240319 (+ 2260us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.240324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.240595 (+ 271us) server_negotiation.cc:407] Connection header received
0807 05:02:14.240815 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.240818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.240873 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.240938 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:14.241971 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.242821 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.243948 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.244320 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.244403 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.246136 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:14.246140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:14.246143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:14.246171 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:14.247644 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:14.248179 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:14.248183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:14.248185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:14.248284 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:14.248594 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:14.248597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:14.248599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:14.249017 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:14.249149 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.249505 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.249651 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2161,"thread_start_us":119,"threads_started":1}
I20260807 05:02:14.255406 13962 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:02:14.259936 13962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:02:14.287992 14749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.276718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:40195 (local address 127.0.0.1:34086)
0807 05:02:14.281065 (+ 4347us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.281130 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:14.281266 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:14.282919 (+ 1653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:14.282926 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:14.282951 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:14.283114 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.283122 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.284529 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.284533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.286000 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.286010 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.287352 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.287355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.287481 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.287537 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 05:02:14.287660 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 05:02:14.287804 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4132,"thread_start_us":136,"threads_started":1}
I20260807 05:02:14.288757 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.277705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.25.214.193:40195)
0807 05:02:14.282136 (+ 4431us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.282144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.282172 (+ 28us) server_negotiation.cc:407] Connection header received
0807 05:02:14.282259 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.282265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.282540 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.282715 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:14.283258 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.284384 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.286145 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.286986 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.287113 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.287275 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.288436 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.288553 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4304,"thread_start_us":103,"threads_started":1}
I20260807 05:02:14.292271 14154 tablet_service.cc:1467] Processing CreateTablet for tablet c4f4a82c2ca54bc08f1235a85fb0109c (DEFAULT_TABLE table=test-table [id=4b314c10d8b64b8299a672e9da7d9243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:14.293591 14154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4f4a82c2ca54bc08f1235a85fb0109c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:14.304705 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.278642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:37809 (local address 127.0.0.1:52700)
0807 05:02:14.281508 (+ 2866us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.281522 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:14.281615 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:14.288555 (+ 6940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:14.288558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:14.288581 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:14.288703 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.288734 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.290412 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.290415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.291654 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.291666 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.304243 (+ 12577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.304247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.304368 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.304401 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 05:02:14.304458 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 05:02:14.304542 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2802,"thread_start_us":112,"threads_started":1}
I20260807 05:02:14.305569 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.279377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41799 (local address 127.0.0.1:43806)
0807 05:02:14.281787 (+ 2410us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.281799 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:14.281870 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:14.300165 (+ 18295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:14.300169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:14.300193 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:14.300295 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.300302 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.301771 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.301775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.302947 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.302975 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.305150 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.305154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.305286 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.305314 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 05:02:14.305369 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 05:02:14.305438 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2353,"thread_start_us":96,"threads_started":1}
I20260807 05:02:14.305626 14747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.278830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52700 (local address 127.25.214.194:37809)
0807 05:02:14.287942 (+ 9112us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.287949 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.287980 (+ 31us) server_negotiation.cc:407] Connection header received
0807 05:02:14.288107 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.288115 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.288367 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.288924 (+ 557us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:14.289120 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.290272 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.291818 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.292689 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.305054 (+ 12365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.305229 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.305371 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.305484 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8966,"thread_start_us":119,"threads_started":1}
I20260807 05:02:14.306344 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.279793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43806 (local address 127.25.214.195:41799)
0807 05:02:14.294320 (+ 14527us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.294327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.294353 (+ 26us) server_negotiation.cc:407] Connection header received
0807 05:02:14.294432 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.294437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.294654 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.295901 (+ 1247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:14.300467 (+ 4566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.301543 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.303133 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.304225 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.305918 (+ 1693us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.306063 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.306114 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.306205 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14400,"thread_start_us":98,"threads_started":1}
I20260807 05:02:14.309479 14588 tablet_service.cc:1467] Processing CreateTablet for tablet c4f4a82c2ca54bc08f1235a85fb0109c (DEFAULT_TABLE table=test-table [id=4b314c10d8b64b8299a672e9da7d9243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:14.309477 14351 tablet_service.cc:1467] Processing CreateTablet for tablet c4f4a82c2ca54bc08f1235a85fb0109c (DEFAULT_TABLE table=test-table [id=4b314c10d8b64b8299a672e9da7d9243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:14.310688 14588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4f4a82c2ca54bc08f1235a85fb0109c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:14.310688 14351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4f4a82c2ca54bc08f1235a85fb0109c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:14.323657 14752 tablet_bootstrap.cc:492] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Bootstrap starting.
I20260807 05:02:14.326740 14752 tablet_bootstrap.cc:654] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:14.327755 14752 log.cc:824] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:14.330920 14752 tablet_bootstrap.cc:492] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: No bootstrap required, opened a new log
I20260807 05:02:14.331193 14752 ts_tablet_manager.cc:1397] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 05:02:14.333541 14751 tablet_bootstrap.cc:492] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: Bootstrap starting.
I20260807 05:02:14.335842 14752 raft_consensus.cc:348] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.336198 14752 raft_consensus.cc:374] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:14.336311 14752 raft_consensus.cc:729] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00d2ceae081146308e5b5d9b4135e898, State: Initialized, Role: FOLLOWER
I20260807 05:02:14.336881 14752 consensus_queue.cc:260] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.338142 14752 ts_tablet_manager.cc:1428] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 05:02:14.338565 14488 heartbeater.cc:503] Master 127.25.214.254:40677 was elected leader, sending a full tablet report...
I20260807 05:02:14.340639 14751 tablet_bootstrap.cc:654] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:14.341158 14753 tablet_bootstrap.cc:492] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Bootstrap starting.
I20260807 05:02:14.343644 14753 tablet_bootstrap.cc:654] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:14.345101 14751 log.cc:824] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:14.349090 14753 log.cc:824] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:14.352176 14751 tablet_bootstrap.cc:492] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: No bootstrap required, opened a new log
I20260807 05:02:14.352463 14751 ts_tablet_manager.cc:1397] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.000s
I20260807 05:02:14.353765 14753 tablet_bootstrap.cc:492] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: No bootstrap required, opened a new log
I20260807 05:02:14.354061 14753 ts_tablet_manager.cc:1397] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.002s
I20260807 05:02:14.356938 14751 raft_consensus.cc:348] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.357265 14751 raft_consensus.cc:374] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:14.357352 14751 raft_consensus.cc:729] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d8a433b9a644c2e94544a794ee7f019, State: Initialized, Role: FOLLOWER
I20260807 05:02:14.357865 14751 consensus_queue.cc:260] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.358382 14753 raft_consensus.cc:348] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.358709 14753 raft_consensus.cc:374] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:14.358808 14753 raft_consensus.cc:729] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18acc1e3062940819403fdb790c4c78d, State: Initialized, Role: FOLLOWER
I20260807 05:02:14.359097 14751 ts_tablet_manager.cc:1428] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 05:02:14.359401 14753 consensus_queue.cc:260] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.359539 14274 heartbeater.cc:503] Master 127.25.214.254:40677 was elected leader, sending a full tablet report...
I20260807 05:02:14.360548 14753 ts_tablet_manager.cc:1428] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260807 05:02:14.360921 14692 heartbeater.cc:503] Master 127.25.214.254:40677 was elected leader, sending a full tablet report...
W20260807 05:02:14.438887 14275 tablet.cc:2369] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:02:14.446928 14489 tablet.cc:2369] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:02:14.459416 14695 tablet.cc:2369] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:02:14.477535 14756 raft_consensus.cc:482] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:14.477799 14756 raft_consensus.cc:504] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.479079 14756 leader_election.cc:288] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d8a433b9a644c2e94544a794ee7f019 (127.25.214.193:40195), 18acc1e3062940819403fdb790c4c78d (127.25.214.195:41799)
I20260807 05:02:14.483729 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.479853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:37821 (local address 127.25.214.193:40195)
0807 05:02:14.480004 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.480009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.480025 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:02:14.480102 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.480105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.480172 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.480235 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:14.480676 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.481203 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.482707 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.483143 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.483214 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.483257 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.483546 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.483613 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:02:14.483741 14770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.479354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:40195 (local address 127.25.214.194:37821)
0807 05:02:14.479662 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.479679 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:14.479785 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:14.480358 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:14.480361 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:14.480379 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:14.480544 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.480551 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.481321 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.481324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.482569 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.482580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.483333 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.483336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.483427 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.483446 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 05:02:14.483507 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 05:02:14.483575 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":41,"thread_start_us":117,"threads_started":1}
I20260807 05:02:14.484372 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.479996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:59079 (local address 127.25.214.195:41799)
0807 05:02:14.480144 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.480148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.480239 (+ 91us) server_negotiation.cc:407] Connection header received
0807 05:02:14.480328 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.480331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.480383 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.480471 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:14.480729 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.481513 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.482880 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.483474 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.483602 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.483653 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.484178 (+ 525us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.484259 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:02:14.484383 14771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.479503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:41799 (local address 127.25.214.194:59079)
0807 05:02:14.480133 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.480146 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:14.480240 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:14.480489 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:14.480491 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:14.480504 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:14.480624 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.480630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.481636 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.481639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.482756 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:14.482764 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.483720 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.483724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:14.483912 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.484063 (+ 151us) client_negotiation.cc:769] Sending connection context
0807 05:02:14.484155 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 05:02:14.484225 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":28,"thread_start_us":97,"threads_started":1}
I20260807 05:02:14.484494 14204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4f4a82c2ca54bc08f1235a85fb0109c" candidate_uuid: "00d2ceae081146308e5b5d9b4135e898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d8a433b9a644c2e94544a794ee7f019" is_pre_election: true
I20260807 05:02:14.484826 14204 raft_consensus.cc:2454] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00d2ceae081146308e5b5d9b4135e898 in term 0.
I20260807 05:02:14.484977 14594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4f4a82c2ca54bc08f1235a85fb0109c" candidate_uuid: "00d2ceae081146308e5b5d9b4135e898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18acc1e3062940819403fdb790c4c78d" is_pre_election: true
I20260807 05:02:14.485278 14594 raft_consensus.cc:2454] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00d2ceae081146308e5b5d9b4135e898 in term 0.
I20260807 05:02:14.485338 14313 leader_election.cc:302] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00d2ceae081146308e5b5d9b4135e898, 3d8a433b9a644c2e94544a794ee7f019; no voters:
I20260807 05:02:14.485633 14756 raft_consensus.cc:2781] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:02:14.485736 14756 raft_consensus.cc:482] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:02:14.485785 14756 raft_consensus.cc:3037] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:14.487213 14756 raft_consensus.cc:504] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.487622 14756 leader_election.cc:288] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [CANDIDATE]: Term 1 election: Requested vote from peers 3d8a433b9a644c2e94544a794ee7f019 (127.25.214.193:40195), 18acc1e3062940819403fdb790c4c78d (127.25.214.195:41799)
I20260807 05:02:14.487983 14594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4f4a82c2ca54bc08f1235a85fb0109c" candidate_uuid: "00d2ceae081146308e5b5d9b4135e898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18acc1e3062940819403fdb790c4c78d"
I20260807 05:02:14.487980 14204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4f4a82c2ca54bc08f1235a85fb0109c" candidate_uuid: "00d2ceae081146308e5b5d9b4135e898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d8a433b9a644c2e94544a794ee7f019"
I20260807 05:02:14.488129 14594 raft_consensus.cc:3037] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:14.488125 14204 raft_consensus.cc:3037] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:14.489360 14204 raft_consensus.cc:2454] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00d2ceae081146308e5b5d9b4135e898 in term 1.
I20260807 05:02:14.489360 14594 raft_consensus.cc:2454] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00d2ceae081146308e5b5d9b4135e898 in term 1.
I20260807 05:02:14.489688 14313 leader_election.cc:302] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00d2ceae081146308e5b5d9b4135e898, 3d8a433b9a644c2e94544a794ee7f019; no voters:
I20260807 05:02:14.489892 14756 raft_consensus.cc:2781] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:14.490088 14756 raft_consensus.cc:686] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 1 LEADER]: Becoming Leader. State: Replica: 00d2ceae081146308e5b5d9b4135e898, State: Running, Role: LEADER
I20260807 05:02:14.490422 14756 consensus_queue.cc:237] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } }
I20260807 05:02:14.493810 13962 catalog_manager.cc:5495] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00d2ceae081146308e5b5d9b4135e898 (127.25.214.194). New cstate: current_term: 1 leader_uuid: "00d2ceae081146308e5b5d9b4135e898" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00d2ceae081146308e5b5d9b4135e898" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 } health_report { overall_health: UNKNOWN } } }
I20260807 05:02:14.533042 14747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.529501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52702 (local address 127.25.214.194:37809)
0807 05:02:14.529627 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:14.529631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:14.529645 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:02:14.529792 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:14.529794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:14.529853 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:14.529944 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:02:14.530185 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.530685 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.531517 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:14.531761 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:14.531852 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:14.532165 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:02:14.532632 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:02:14.532737 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:14.532832 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 05:02:14.532891 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:02:14.538928 14594 raft_consensus.cc:1261] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 1 FOLLOWER]: Refusing update from remote peer 00d2ceae081146308e5b5d9b4135e898: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:14.538928 14204 raft_consensus.cc:1261] T c4f4a82c2ca54bc08f1235a85fb0109c P 3d8a433b9a644c2e94544a794ee7f019 [term 1 FOLLOWER]: Refusing update from remote peer 00d2ceae081146308e5b5d9b4135e898: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:14.539646 14772 consensus_queue.cc:1035] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18acc1e3062940819403fdb790c4c78d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 41799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:14.539850 14756 consensus_queue.cc:1035] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d8a433b9a644c2e94544a794ee7f019" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:14.547539 14776 mvcc.cc:205] Tried to move back new op lower bound from 7315779315863834624 to 7315779315675308032. Current Snapshot: MvccSnapshot[applied={T|T < 7315779315863834624}]
I20260807 05:02:14.548238 14779 mvcc.cc:205] Tried to move back new op lower bound from 7315779315863834624 to 7315779315675308032. Current Snapshot: MvccSnapshot[applied={T|T < 7315779315863834624}]
I20260807 05:02:14.554617 14780 mvcc.cc:205] Tried to move back new op lower bound from 7315779315863834624 to 7315779315675308032. Current Snapshot: MvccSnapshot[applied={T|T < 7315779315863834624 or (T in {7315779315863834624})}]
I20260807 05:02:14.558753 13962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:14.558928 13962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:14.561470 13962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e81db31640d54b758a3ee7ab972dcb23: Sending DeleteTablet for 3 replicas of tablet c4f4a82c2ca54bc08f1235a85fb0109c
I20260807 05:02:14.562232 14154 tablet_service.cc:1514] Processing DeleteTablet for tablet c4f4a82c2ca54bc08f1235a85fb0109c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:14 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:34086
I20260807 05:02:14.562361 14351 tablet_service.cc:1514] Processing DeleteTablet for tablet c4f4a82c2ca54bc08f1235a85fb0109c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:14 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:52700
I20260807 05:02:14.562773 14588 tablet_service.cc:1514] Processing DeleteTablet for tablet c4f4a82c2ca54bc08f1235a85fb0109c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:14 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:43806
I20260807 05:02:14.563095 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 14023
I20260807 05:02:14.579034 14793 tablet_replica.cc:330] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: stopping tablet replica
I20260807 05:02:14.579434 14793 raft_consensus.cc:2229] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:14.579820 14793 raft_consensus.cc:2258] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:14.581687 14793 ts_tablet_manager.cc:1905] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:14.584620 14790 tablet_replica.cc:330] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: stopping tablet replica
I20260807 05:02:14.584858 14793 ts_tablet_manager.cc:1918] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:14.584939 14790 raft_consensus.cc:2229] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:02:14.585059 14793 log.cc:1196] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/c4f4a82c2ca54bc08f1235a85fb0109c
I20260807 05:02:14.585309 14790 raft_consensus.cc:2258] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:14.585546 14793 ts_tablet_manager.cc:1939] T c4f4a82c2ca54bc08f1235a85fb0109c P 18acc1e3062940819403fdb790c4c78d: Deleting consensus metadata
I20260807 05:02:14.586771 14790 ts_tablet_manager.cc:1905] T c4f4a82c2ca54bc08f1235a85fb0109c P 00d2ceae081146308e5b5d9b4135e898: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:14.586874 13946 catalog_manager.cc:4841] TS 18acc1e3062940819403fdb790c4c78d (127.25.214.195:41799): tablet c4f4a82c2ca54bc08f1235a85fb0109c (table test-table [id=4b314c10d8b64b8299a672e9da7d9243]) successfully deleted
W20260807 05:02:14.588202 13947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:40195 (error 108)
I20260807 05:02:14.589227 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.588944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:40195 (local address 127.0.0.1:34088)
0807 05:02:14.589072 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.589140 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:40195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 05:02:14.589316 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 14284
W20260807 05:02:14.589532 13947 catalog_manager.cc:4584] TS 3d8a433b9a644c2e94544a794ee7f019 (127.25.214.193:40195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4f4a82c2ca54bc08f1235a85fb0109c: Network error: Client connection negotiation failed: client connection to 127.25.214.193:40195: connect: Connection refused (error 111)
I20260807 05:02:14.608938 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 14491
I20260807 05:02:14.611784 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:14.611417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:37809 (local address 127.0.0.1:52708)
0807 05:02:14.611627 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:14.611685 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.194:37809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260807 05:02:14.618286 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 13921
I20260807 05:02:14.637980 26459 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 05:02:14.982626 26459 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 05:02:14.982750 26459 mini_ranger.cc:66] Stopping Ranger...
I20260807 05:02:15.327675 26459 mini_ranger.cc:68] Stopped Ranger
2026-08-07 05:02:15.327 UTC [12560] LOG: received smart shutdown request
2026-08-07 05:02:15.331 UTC [12560] LOG: background worker "logical replication launcher" (PID 12574) exited with exit code 1
2026-08-07 05:02:15.332 UTC [12566] LOG: shutting down
2026-08-07 05:02:15.473 UTC [12560] LOG: database system is shut down
2026-08-07T05:02:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48491 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:02:15 dist-test-slave-lgr5 krb5kdc[14809](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:02:15 dist-test-slave-lgr5 krb5kdc[14809](info): set up 2 sockets
Aug 07 05:02:15 dist-test-slave-lgr5 krb5kdc[14809](info): commencing operation
krb5kdc: starting...
W20260807 05:02:16.733338 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:02:16 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:02:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:02:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:02:16.859148 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:41729
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:41729,127.25.214.253:37669,127.25.214.252:36865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:16.974679 14832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:16.974990 14832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:16.975033 14832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:16.979192 14832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:16.979279 14832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:16.979298 14832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:16.979314 14832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:16.979341 14832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:16.985054 14832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:41729,127.25.214.253:37669,127.25.214.252:36865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:41729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:16.986275 14832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:16.987433 14832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:16.996990 14847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:16.997004 14840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:16.997004 14842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:16.997100 14832 server_base.cc:1034] running on GCE node
I20260807 05:02:16.997903 14832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:16.999131 14832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:17.000298 14832 hybrid_clock.cc:648] HybridClock initialized: now 1786078937000269 us; error 41 us; skew 500 ppm
Aug 07 05:02:16 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:17.003304 14832 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:17.004405 14832 webserver.cc:460] Webserver started at http://127.25.214.254:39059/ using document root <none> and password file <none>
I20260807 05:02:17.004983 14832 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:17.005066 14832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:17.005293 14832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:17.007474 14832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "a1fee0bc75ce4c77b780d92d74f737b5"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "f2477b08542a0445cb79b4e8f94575c8"
server_key_iv: "68a44858f785421d902f2c608fa872a8"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.008062 14832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "a1fee0bc75ce4c77b780d92d74f737b5"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "f2477b08542a0445cb79b4e8f94575c8"
server_key_iv: "68a44858f785421d902f2c608fa872a8"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.012002 14832 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:02:17.014672 14860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:17.015997 14832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 05:02:17.016151 14832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "a1fee0bc75ce4c77b780d92d74f737b5"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "f2477b08542a0445cb79b4e8f94575c8"
server_key_iv: "68a44858f785421d902f2c608fa872a8"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.016273 14832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:17.033663 14832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:17.037045 14832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:17.037238 14832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:17.044387 14832 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:41729
I20260807 05:02:17.044716 14943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:41729 every 8 connection(s)
I20260807 05:02:17.045410 14832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:17.046176 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 14832
I20260807 05:02:17.046310 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:02:17.046639 26459 external_mini_cluster.cc:1428] Setting key d86d51227e002e6fe1539ec2d36f5fe2
I20260807 05:02:17.049113 14945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:17.053480 14945 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.214.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.253@KRBTEST.COM" created.
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:17.070376 14950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.056260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52184 (local address 127.25.214.254:41729)
0807 05:02:17.056825 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.056844 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.057056 (+ 212us) server_negotiation.cc:407] Connection header received
0807 05:02:17.058266 (+ 1210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.058272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.058466 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.058627 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.059776 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.061175 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.062182 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.062577 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.062731 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.065388 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.065394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.065406 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.065429 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.067013 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.067472 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.067477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.067479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.067615 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.067951 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.067954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.067956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.068496 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.068645 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.069139 (+ 494us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.069362 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":168,"threads_started":1}
I20260807 05:02:17.070377 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.056260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:41729 (local address 127.0.0.1:52184)
0807 05:02:17.056897 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.056942 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.057904 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.058683 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.058689 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.059156 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.059539 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.059578 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.061306 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.061308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.062063 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.062073 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.062736 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.062740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.062852 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.063481 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.063498 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.065235 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.067122 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.067132 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.067144 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.067362 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.067723 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.067726 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.067728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.067860 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.068645 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.068651 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.068846 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.069083 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.069533 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":99,"spinlock_wait_cycles":16256,"thread_start_us":184,"threads_started":1}
I20260807 05:02:17.073246 14945 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab.
Entry for principal kudu/127.25.214.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab.
I20260807 05:02:17.074218 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.073851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60826)
0807 05:02:17.074013 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.074114 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 05:02:17.074499 14865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
I20260807 05:02:17.075155 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:37669
--webserver_interface=127.25.214.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab
--principal=kudu/127.25.214.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:41729,127.25.214.253:37669,127.25.214.252:36865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:17.075522 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.075244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60838)
0807 05:02:17.075416 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.075460 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260807 05:02:17.075659 14945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:37669: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
I20260807 05:02:17.124933 14945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } attempt: 1
I20260807 05:02:17.125998 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.125614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60840)
0807 05:02:17.125802 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.125889 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 05:02:17.126772 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.126518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60854)
0807 05:02:17.126637 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.126700 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 05:02:17.126916 14945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:37669: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
I20260807 05:02:17.195128 14945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } attempt: 2
W20260807 05:02:17.195679 14958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:17.196039 14958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260807 05:02:17.196126 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.195724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60858)
0807 05:02:17.195913 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.195994 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260807 05:02:17.196156 14958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 05:02:17.196973 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.196711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60860)
0807 05:02:17.196826 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.196894 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 05:02:17.197140 14945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:37669: Network error: Client connection negotiation failed: client connection to 127.25.214.253:37669: connect: Connection refused (error 111)
W20260807 05:02:17.200595 14958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:17.200665 14958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:17.200687 14958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:17.200706 14958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:17.200730 14958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:17.206235 14958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:41729,127.25.214.253:37669,127.25.214.252:36865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab
--principal=kudu/127.25.214.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:37669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.214.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:17.207333 14958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:17.208407 14958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:17.217011 14966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:17.217011 14968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:17.217178 14958 server_base.cc:1034] running on GCE node
W20260807 05:02:17.217360 14965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:17.217942 14958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:17.219076 14958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:17.220228 14958 hybrid_clock.cc:648] HybridClock initialized: now 1786078937220209 us; error 34 us; skew 500 ppm
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:17.222913 14958 init.cc:377] Logged in from keytab as kudu/127.25.214.253@KRBTEST.COM (short username kudu)
I20260807 05:02:17.223810 14958 webserver.cc:460] Webserver started at http://127.25.214.253:43567/ using document root <none> and password file <none>
I20260807 05:02:17.224395 14958 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:17.224472 14958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:17.224680 14958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:17.226734 14958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data/instance:
uuid: "093b068b389b41289a44b5c0aef2c580"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "dd0ffe54a6da9fbbda030fa4e64ff8af"
server_key_iv: "ea5a8035bbee6dd137faced0c816f6ea"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.227277 14958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal/instance:
uuid: "093b068b389b41289a44b5c0aef2c580"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "dd0ffe54a6da9fbbda030fa4e64ff8af"
server_key_iv: "ea5a8035bbee6dd137faced0c816f6ea"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.230944 14958 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 05:02:17.233434 14977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:17.234732 14958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:02:17.234865 14958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal
uuid: "093b068b389b41289a44b5c0aef2c580"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "dd0ffe54a6da9fbbda030fa4e64ff8af"
server_key_iv: "ea5a8035bbee6dd137faced0c816f6ea"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.234988 14958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:17.247736 14958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:17.250556 14958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:17.250739 14958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:17.257829 14958 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.253:37669
I20260807 05:02:17.257845 15058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.253:37669 every 8 connection(s)
I20260807 05:02:17.258854 14958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
I20260807 05:02:17.261925 15059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:17.262548 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 14958
I20260807 05:02:17.262696 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-1/wal/instance
I20260807 05:02:17.263036 26459 external_mini_cluster.cc:1428] Setting key f725d47e8cf0b591f029258ecc65d285
I20260807 05:02:17.266554 15059 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.214.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.252@KRBTEST.COM" created.
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:17.280611 14950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.268549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52188 (local address 127.25.214.254:41729)
0807 05:02:17.268709 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.268715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.269631 (+ 916us) server_negotiation.cc:407] Connection header received
0807 05:02:17.270807 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.270809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.270860 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.270932 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.272461 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.273069 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.274246 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.274532 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.274612 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.276988 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.276993 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.276996 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.277026 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.278332 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.278941 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.278944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.278945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.279030 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.279394 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.279396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.279397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.279565 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.279633 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.280358 (+ 725us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.280476 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 05:02:17.281823 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.268901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:41729 (local address 127.0.0.1:52188)
0807 05:02:17.269439 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.269502 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.270586 (+ 1084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.271155 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.271164 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.271613 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.272302 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.272320 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.273184 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.273187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.274128 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.274139 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.274682 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.274686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.274827 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.275406 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.275422 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.276810 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.278458 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.278465 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.278483 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.278845 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.279120 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.279123 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.279125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.279312 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.279661 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.279668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.280048 (+ 380us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.280312 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.280687 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":121,"threads_started":1}
I20260807 05:02:17.283344 15059 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:02:17.288290 14945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } attempt: 3
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab.
Entry for principal kudu/127.25.214.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab.
I20260807 05:02:17.291149 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:36865
--webserver_interface=127.25.214.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab
--principal=kudu/127.25.214.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:33625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:41729,127.25.214.253:37669,127.25.214.252:36865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
I20260807 05:02:17.293838 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.283880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60870)
0807 05:02:17.284057 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.284071 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.284174 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.284703 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.284705 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.284832 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.284926 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.284959 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.285955 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.285957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.286540 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.286550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.287237 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.287242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.287353 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.287797 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.287808 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.289231 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.292121 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.292125 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.292127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.292349 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.292651 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.292654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.292656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.292750 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.293313 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.293315 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.293397 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.293496 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.293620 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 05:02:17.293995 15070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.283979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60870 (local address 127.25.214.253:37669)
0807 05:02:17.284340 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.284356 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.284375 (+ 19us) server_negotiation.cc:407] Connection header received
0807 05:02:17.284409 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.284413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.284581 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.284686 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.285070 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.285856 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.286660 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.287075 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.287168 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.289363 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.289374 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.289388 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.289439 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.291964 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.292467 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.292472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.292473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.292554 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.292845 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.292848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.292850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.293141 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.293266 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.293640 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.293794 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":189,"threads_started":1}
I20260807 05:02:17.296144 15059 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:02:17.296994 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.296655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50488)
0807 05:02:17.296823 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.296901 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260807 05:02:17.297186 14980 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
I20260807 05:02:17.297734 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.288744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60872)
0807 05:02:17.288871 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.288885 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.288967 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.289311 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.289314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.289507 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.289613 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.289621 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.290399 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.290402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.290944 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.290952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.292160 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.292164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.292270 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.292641 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.292655 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.294400 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.296218 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.296221 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.296223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.296465 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.296716 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.296719 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.296722 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.296805 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.297209 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.297211 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.297311 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.297421 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.297572 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 05:02:17.297747 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.288771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60872 (local address 127.25.214.253:37669)
0807 05:02:17.289086 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.289095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.289108 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:02:17.289141 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.289144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.289198 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.289292 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.289720 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.290255 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.291052 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.292011 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.292155 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.294540 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.294545 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.294547 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.294571 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.296123 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.296548 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.296551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.296553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.296633 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.296886 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.296889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.296891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.297074 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.297162 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.297488 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.297590 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":94,"threads_started":1}
I20260807 05:02:17.298488 14945 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:02:17.299127 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.298913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50490)
0807 05:02:17.299021 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.299072 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 05:02:17.299829 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.299592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50504)
0807 05:02:17.299737 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.299779 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260807 05:02:17.299943 14945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:36865: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
I20260807 05:02:17.304790 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.304562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50516)
0807 05:02:17.304671 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.304723 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 05:02:17.305008 15059 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:36865: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
I20260807 05:02:17.331115 14945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } attempt: 1
I20260807 05:02:17.332036 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.331721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50532)
0807 05:02:17.331883 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.331949 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 05:02:17.332767 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.332559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50536)
0807 05:02:17.332662 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.332708 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 05:02:17.332906 14945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:36865: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
I20260807 05:02:17.354280 15059 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } attempt: 1
I20260807 05:02:17.355262 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.354926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50538)
0807 05:02:17.355108 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.355174 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 05:02:17.355959 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.355765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50542)
0807 05:02:17.355854 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.355900 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 05:02:17.356114 15059 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:36865: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
I20260807 05:02:17.408110 14945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } attempt: 2
I20260807 05:02:17.409086 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.408764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50554)
0807 05:02:17.408929 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.408999 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 05:02:17.409829 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.409607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50570)
0807 05:02:17.409718 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.409763 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 05:02:17.409943 14945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:36865: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
W20260807 05:02:17.410801 15072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:17.411098 15072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:17.411167 15072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:17.415284 15072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:17.415350 15072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:17.415378 15072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:17.415409 15072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:17.415438 15072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:17.420872 15072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:33625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:41729,127.25.214.253:37669,127.25.214.252:36865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab
--principal=kudu/127.25.214.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:36865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.214.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:17.422005 15072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:17.423020 15072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:02:17.424247 15059 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } attempt: 2
I20260807 05:02:17.425043 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.424756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50576)
0807 05:02:17.424899 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.424959 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 05:02:17.425716 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.425494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50586)
0807 05:02:17.425607 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.425665 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 05:02:17.425832 15059 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:36865: Network error: Client connection negotiation failed: client connection to 127.25.214.252:36865: connect: Connection refused (error 111)
W20260807 05:02:17.431334 15086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:17.431371 15081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:17.431353 15083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:17.431612 15072 server_base.cc:1034] running on GCE node
I20260807 05:02:17.432296 15072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:17.433365 15072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:17.434546 15072 hybrid_clock.cc:648] HybridClock initialized: now 1786078937434514 us; error 29 us; skew 500 ppm
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:17.437178 15072 init.cc:377] Logged in from keytab as kudu/127.25.214.252@KRBTEST.COM (short username kudu)
I20260807 05:02:17.438031 15072 webserver.cc:460] Webserver started at http://127.25.214.252:39715/ using document root <none> and password file <none>
I20260807 05:02:17.438560 15072 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:17.438618 15072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:17.438789 15072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:17.440867 15072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data/instance:
uuid: "ff311a195ff143d79df5c91593b1dc59"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "f103939ce0c46eb9c193b1fbccab1917"
server_key_iv: "bd9635839dc5a5a85808ecaac969a554"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.441376 15072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal/instance:
uuid: "ff311a195ff143d79df5c91593b1dc59"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "f103939ce0c46eb9c193b1fbccab1917"
server_key_iv: "bd9635839dc5a5a85808ecaac969a554"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.444868 15072 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:02:17.447098 15096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:17.448258 15072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:02:17.448365 15072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal
uuid: "ff311a195ff143d79df5c91593b1dc59"
format_stamp: "Formatted at 2026-08-07 05:02:17 on dist-test-slave-lgr5"
server_key: "f103939ce0c46eb9c193b1fbccab1917"
server_key_iv: "bd9635839dc5a5a85808ecaac969a554"
server_key_version: "encryptionkey@0"
I20260807 05:02:17.448462 15072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:17.476858 15072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:17.479928 15072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:17.480142 15072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:17.487079 15072 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.252:36865
I20260807 05:02:17.487351 15191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.252:36865 every 8 connection(s)
I20260807 05:02:17.488101 15072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
I20260807 05:02:17.489979 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 15072
I20260807 05:02:17.490095 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786078774062608-26459-0/minicluster-data/master-2/wal/instance
I20260807 05:02:17.490377 26459 external_mini_cluster.cc:1428] Setting key db29b9b6caee4493ebb99bd1e681333d
I20260807 05:02:17.491071 15193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:17.495435 15193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:17.505259 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.491707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50596 (local address 127.25.214.252:36865)
0807 05:02:17.492132 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.492151 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.492188 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:02:17.492827 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.492844 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.493166 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.493432 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.494375 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.495405 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.496599 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.497110 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.497271 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.500161 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.500169 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.500183 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.500217 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.502008 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.502412 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.502419 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.502426 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.502580 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.502871 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.502874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.502876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.503330 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.503477 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.503835 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.504175 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":117,"threads_started":1}
I20260807 05:02:17.507125 14950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.497688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52190 (local address 127.25.214.254:41729)
0807 05:02:17.497841 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.497846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.498279 (+ 433us) server_negotiation.cc:407] Connection header received
0807 05:02:17.498430 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.498433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.498487 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.498552 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.499357 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.500110 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.501306 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.501540 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.501619 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.504072 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.504104 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.504107 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.504135 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.505502 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.505900 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.505904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.505905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.505991 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.506213 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.506216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.506218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.506441 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.506527 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.506870 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.506972 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 05:02:17.507273 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.497620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:41729 (local address 127.0.0.1:52190)
0807 05:02:17.498130 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.498191 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.498334 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.498636 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.498642 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.499093 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.499233 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.499240 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.500215 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.500218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.501175 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.501197 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.501649 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.501653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.501766 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.502478 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.502491 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.503886 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.505599 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.505606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.505611 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.505811 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.506073 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.506075 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.506076 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.506142 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.506559 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.506564 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.506678 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.506819 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.506983 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":173,"threads_started":1}
I20260807 05:02:17.508347 15193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:02:17.509972 14945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } attempt: 3
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:02:17.516971 15059 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } attempt: 3
I20260807 05:02:17.517304 14950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.507796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52196 (local address 127.25.214.254:41729)
0807 05:02:17.507891 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.507895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.507949 (+ 54us) server_negotiation.cc:407] Connection header received
0807 05:02:17.508074 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.508095 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.508142 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.508205 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.508881 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.509725 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.510638 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.510935 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.511050 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.513795 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.513799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.513801 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.513825 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.515195 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.515623 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.515626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.515628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.515698 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.515965 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.515969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.515970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.516337 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.516562 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.516732 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.516843 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:02:17.518982 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.508965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60880 (local address 127.25.214.253:37669)
0807 05:02:17.510585 (+ 1620us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.510590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.510604 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:02:17.510646 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.510649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.510697 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.510762 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.511288 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.511898 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.512678 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.512929 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.513016 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.515632 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.515636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.515639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.515666 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.517204 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.517698 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.517702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.517704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.517789 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.518079 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.518083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.518085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.518258 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.518342 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.518717 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.518836 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 05:02:17.519448 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.508852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:37669 (local address 127.0.0.1:60880)
0807 05:02:17.508945 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.508958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.509026 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.510869 (+ 1843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.510872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.511053 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.511169 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.511177 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.512006 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.512009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.512568 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.512577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.513027 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.513031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.513200 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.513605 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.513620 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.515469 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.517324 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.517327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.517329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.517581 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.517903 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.517905 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.517907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.517998 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.518428 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.518431 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.518523 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.519159 (+ 636us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.519295 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":53}
I20260807 05:02:17.519666 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.510316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50604)
0807 05:02:17.510415 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.510428 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.510499 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.510709 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.510712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.510868 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.510938 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.510943 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.511839 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.511843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.512653 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.512664 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.513378 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.513381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.513473 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.513848 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.513861 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.515469 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.517906 (+ 2437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.517910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.517912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.518153 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.518693 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.518696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.518698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.518790 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.519226 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.519229 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.519320 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.519399 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.519514 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 05:02:17.520180 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.510387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.25.214.252:36865)
0807 05:02:17.510498 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.510501 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.510515 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:02:17.510571 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.510574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.510617 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.510687 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.511060 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.511708 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.512799 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.513243 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.513672 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.515586 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.515589 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.515592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.515616 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.517789 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.518274 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.518277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.518279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.518357 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.518902 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.518905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.518907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.519113 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.519819 (+ 706us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.519891 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.520012 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":42}
I20260807 05:02:17.520800 15193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:02:17.523808 14945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: Bootstrap starting.
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
Aug 07 05:02:17 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078937, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:02:17.526921 14945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:17.527878 14945 log.cc:824] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:17.528983 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.517387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50620)
0807 05:02:17.517489 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.517503 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.517576 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.518989 (+ 1413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.518992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.519153 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.519260 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.519267 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.521288 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.521291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.522036 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.522047 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.522897 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.522903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.522990 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.523403 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.523417 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.525312 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.527228 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.527231 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.527234 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.527583 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.527909 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.527913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.527915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.528006 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.528490 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.528493 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.528595 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.528673 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.528807 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 05:02:17.529776 15070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.518446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.25.214.253:37669)
0807 05:02:17.518550 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.518553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.518567 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:02:17.518642 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.518645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.518704 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.518784 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.519608 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.520355 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.521847 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.522188 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.522264 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.525917 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.525920 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.525923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.525947 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.527529 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.527999 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.528003 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.528005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.528137 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.528452 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.528455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.528457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.528685 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.528907 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.529515 (+ 608us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.529641 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:02:17.529789 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.517646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50620 (local address 127.25.214.252:36865)
0807 05:02:17.518765 (+ 1119us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.518773 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.518785 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:02:17.518814 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.518817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.518856 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.519940 (+ 1084us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.520022 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.521169 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.522173 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.522524 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.523980 (+ 1456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.525450 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.525454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.525457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.525493 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.527110 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.527702 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.527705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.527707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.527802 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.528149 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.528152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.528154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.528358 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.529286 (+ 928us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.529354 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.529611 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1055,"thread_start_us":133,"threads_started":1}
I20260807 05:02:17.530388 14945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: No bootstrap required, opened a new log
I20260807 05:02:17.530584 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.521266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:36865 (local address 127.0.0.1:50624)
0807 05:02:17.521521 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:17.521532 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:17.521596 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:17.521887 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:17.521890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:17.522074 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:17.522151 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.522158 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.523009 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.523012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.523721 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:17.523732 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.524315 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.524319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:17.524388 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.524808 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:17.524821 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:17.526836 (+ 2015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:17.528682 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.528684 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.528686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.528895 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.529406 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:17.529409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:17.529410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:17.529490 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:17.530154 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:17.530157 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:17.530246 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 05:02:17.530331 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:02:17.530449 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202}
I20260807 05:02:17.531113 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.521442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50624 (local address 127.25.214.252:36865)
0807 05:02:17.521701 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.521704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.521712 (+ 8us) server_negotiation.cc:407] Connection header received
0807 05:02:17.521735 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.521738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.521766 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.521818 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.522245 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.522900 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.523839 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.524218 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.524303 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.526974 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.527024 (+ 50us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.527027 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.527054 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.528586 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.529000 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.529003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.529005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.529318 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.529572 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.529575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.529577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.529748 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.530811 (+ 1063us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.530877 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.530988 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211}
I20260807 05:02:17.533070 15059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580: Bootstrap starting.
I20260807 05:02:17.533529 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:02:17.534101 15193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: Bootstrap starting.
I20260807 05:02:17.535508 15059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:17.536491 15193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:17.536456 15059 log.cc:824] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:17.537273 15193 log.cc:824] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:17.538563 15059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580: No bootstrap required, opened a new log
I20260807 05:02:17.539357 15193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: No bootstrap required, opened a new log
I20260807 05:02:17.541515 14945 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.541780 14945 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:17.541839 14945 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1fee0bc75ce4c77b780d92d74f737b5, State: Initialized, Role: FOLLOWER
I20260807 05:02:17.542347 14945 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.542378 15059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.542572 15059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:17.542618 15059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 093b068b389b41289a44b5c0aef2c580, State: Initialized, Role: FOLLOWER
I20260807 05:02:17.543071 15059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.543691 14945 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:17.544037 15193 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.544278 15059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:17.544368 15193 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:17.544459 15193 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff311a195ff143d79df5c91593b1dc59, State: Initialized, Role: FOLLOWER
I20260807 05:02:17.544910 15193 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.546144 15193 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 05:02:17.552131 15238 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:02:17.552208 15238 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:02:17.552824 15215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.553056 15215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.553210 15215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:17.553377 15215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
W20260807 05:02:17.554025 15246 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:02:17.554116 15246 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:02:17.554033 14958 master_runner.cc:263] No leader master found from master 093b068b389b41289a44b5c0aef2c580
I20260807 05:02:17.554383 14958 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 05:02:17.554464 14950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.536695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52208 (local address 127.25.214.254:41729)
0807 05:02:17.536834 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.536839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.536853 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:02:17.536891 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.536894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.536937 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.537022 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.538238 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.539011 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.540321 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.540643 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.540719 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.550185 (+ 9466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.550189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.550192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.550219 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.551818 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.553052 (+ 1234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.553056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.553058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.553147 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.553463 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.553466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.553468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.553702 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.553814 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.554187 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.554313 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 05:02:17.554741 15215 leader_election.cc:288] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1fee0bc75ce4c77b780d92d74f737b5 (127.25.214.254:41729), ff311a195ff143d79df5c91593b1dc59 (127.25.214.252:36865)
I20260807 05:02:17.554986 14899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093b068b389b41289a44b5c0aef2c580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" is_pre_election: true
I20260807 05:02:17.555290 14899 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 093b068b389b41289a44b5c0aef2c580 in term 0.
I20260807 05:02:17.555305 15144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093b068b389b41289a44b5c0aef2c580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff311a195ff143d79df5c91593b1dc59" is_pre_election: true
I20260807 05:02:17.555577 15144 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 093b068b389b41289a44b5c0aef2c580 in term 0.
I20260807 05:02:17.555934 14980 leader_election.cc:302] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 093b068b389b41289a44b5c0aef2c580, ff311a195ff143d79df5c91593b1dc59; no voters:
I20260807 05:02:17.556345 14832 master_runner.cc:263] No leader master found from master a1fee0bc75ce4c77b780d92d74f737b5
I20260807 05:02:17.556413 14832 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 05:02:17.557155 15072 master_runner.cc:263] No leader master found from master ff311a195ff143d79df5c91593b1dc59
I20260807 05:02:17.557221 15072 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 05:02:17.560228 15269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:02:17.560372 15269 raft_consensus.cc:482] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:02:17.560439 15269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:17.561425 15269 raft_consensus.cc:504] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.561784 15269 leader_election.cc:288] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [CANDIDATE]: Term 1 election: Requested vote from peers a1fee0bc75ce4c77b780d92d74f737b5 (127.25.214.254:41729), ff311a195ff143d79df5c91593b1dc59 (127.25.214.252:36865)
I20260807 05:02:17.562026 15227 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.562146 15227 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.562121 15144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093b068b389b41289a44b5c0aef2c580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff311a195ff143d79df5c91593b1dc59"
I20260807 05:02:17.562171 14899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093b068b389b41289a44b5c0aef2c580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1fee0bc75ce4c77b780d92d74f737b5"
I20260807 05:02:17.562263 15144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:17.562280 14899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:17.563470 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.536817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50636 (local address 127.25.214.252:36865)
0807 05:02:17.537173 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.537177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.537189 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:02:17.537221 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.537224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.537260 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.537326 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.542293 (+ 4967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.542958 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.544018 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.544337 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.544413 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.559325 (+ 14912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.559329 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.559333 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.559361 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.561016 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.561510 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.561514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.561516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.561606 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.562513 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.562517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.562519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.562727 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.562843 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.563203 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.563322 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286}
I20260807 05:02:17.563544 14899 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 093b068b389b41289a44b5c0aef2c580 in term 1.
I20260807 05:02:17.563553 15144 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 093b068b389b41289a44b5c0aef2c580 in term 1.
I20260807 05:02:17.563833 14980 leader_election.cc:302] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 093b068b389b41289a44b5c0aef2c580, ff311a195ff143d79df5c91593b1dc59; no voters:
I20260807 05:02:17.564006 15269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:17.564144 15269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [term 1 LEADER]: Becoming Leader. State: Replica: 093b068b389b41289a44b5c0aef2c580, State: Running, Role: LEADER
I20260807 05:02:17.564486 15269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } }
I20260807 05:02:17.566345 15269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 093b068b389b41289a44b5c0aef2c580. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.566484 15269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:17.566819 15214 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.566959 15214 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.567288 15272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:17.568583 15070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:17.537132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60890 (local address 127.25.214.253:37669)
0807 05:02:17.537237 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:17.537241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:17.555449 (+ 18208us) server_negotiation.cc:407] Connection header received
0807 05:02:17.555630 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:17.555634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:17.555680 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:17.555729 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:17.556512 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.557286 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.558385 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:17.558716 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:17.558795 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:17.564948 (+ 6153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:17.564952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:17.564955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:17.564993 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:17.566581 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.567089 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.567094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.567096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.567189 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:17.567502 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:17.567505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:17.567507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:17.567722 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:17.567828 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:17.568270 (+ 442us) server_negotiation.cc:299] Negotiation successful
0807 05:02:17.568406 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 05:02:17.572178 15266 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:02:17.572348 15266 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:02:17.568406 15272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:17.589112 14899 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [term 1 FOLLOWER]: Refusing update from remote peer 093b068b389b41289a44b5c0aef2c580: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:17.589112 15144 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [term 1 FOLLOWER]: Refusing update from remote peer 093b068b389b41289a44b5c0aef2c580: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:17.590078 15269 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:17.590404 15215 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:17.594359 15227 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 093b068b389b41289a44b5c0aef2c580. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.594496 15227 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.594636 15214 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 093b068b389b41289a44b5c0aef2c580. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.594738 15214 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.600934 15269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.601073 15269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:17.602098 15227 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.602213 15227 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.602509 15274 mvcc.cc:205] Tried to move back new op lower bound from 7315779328355057664 to 7315779328267304960. Current Snapshot: MvccSnapshot[applied={T|T < 7315779328355057664}]
I20260807 05:02:17.605329 15278 mvcc.cc:205] Tried to move back new op lower bound from 7315779328355057664 to 7315779328267304960. Current Snapshot: MvccSnapshot[applied={T|T < 7315779328355057664}]
I20260807 05:02:17.606029 15215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.606151 15215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:17.607241 15214 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "093b068b389b41289a44b5c0aef2c580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1fee0bc75ce4c77b780d92d74f737b5" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41729 } } peers { permanent_uuid: "093b068b389b41289a44b5c0aef2c580" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 37669 } } peers { permanent_uuid: "ff311a195ff143d79df5c91593b1dc59" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 36865 } } }
I20260807 05:02:17.607360 15214 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:02:17.608153 15279 mvcc.cc:205] Tried to move back new op lower bound from 7315779328355057664 to 7315779328267304960. Current Snapshot: MvccSnapshot[applied={T|T < 7315779328355057664}]
I20260807 05:02:17.609750 15272 catalog_manager.cc:1347] Generated new cluster ID: ef1955ba9ade4b8f8d901f1040224424
I20260807 05:02:17.609814 15272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:17.645982 15272 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:02:17.647297 15272 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:17.658771 15272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 093b068b389b41289a44b5c0aef2c580: Generated new TSK 0
I20260807 05:02:17.659761 15272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:02:18.553601 15238 catalog_manager.cc:1259] Loaded cluster ID: ef1955ba9ade4b8f8d901f1040224424
I20260807 05:02:18.553687 15238 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: loading cluster ID for follower catalog manager: success
I20260807 05:02:18.555399 15238 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: acquiring CA information for follower catalog manager: success
I20260807 05:02:18.556615 15238 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a1fee0bc75ce4c77b780d92d74f737b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:02:18.573764 15266 catalog_manager.cc:1259] Loaded cluster ID: ef1955ba9ade4b8f8d901f1040224424
I20260807 05:02:18.573863 15266 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: loading cluster ID for follower catalog manager: success
I20260807 05:02:18.575515 15266 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: acquiring CA information for follower catalog manager: success
I20260807 05:02:18.576676 15266 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ff311a195ff143d79df5c91593b1dc59: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:02:18.726233 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 14832
I20260807 05:02:18.740795 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 14958
I20260807 05:02:18.753811 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 15072
2026-08-07T05:02:18Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3181 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:02:18 dist-test-slave-lgr5 krb5kdc[15302](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:02:18 dist-test-slave-lgr5 krb5kdc[15302](info): set up 2 sockets
Aug 07 05:02:18 dist-test-slave-lgr5 krb5kdc[15302](info): commencing operation
krb5kdc: starting...
W20260807 05:02:19.890808 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:02:19 dist-test-slave-lgr5 krb5kdc[15302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:02:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:02:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:02:20.022557 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33591
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:33591
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:20.132519 15320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:20.132781 15320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:20.132838 15320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:20.136804 15320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:20.136859 15320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:20.136883 15320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:20.136906 15320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:20.136934 15320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:20.142256 15320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:33591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:20.143226 15320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:20.144233 15320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:20.152206 15327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:20.152283 15320 server_base.cc:1034] running on GCE node
W20260807 05:02:20.152211 15325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:20.152426 15334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:20.152953 15320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:20.153976 15320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:20.155130 15320 hybrid_clock.cc:648] HybridClock initialized: now 1786078940155110 us; error 33 us; skew 500 ppm
Aug 07 05:02:20 dist-test-slave-lgr5 krb5kdc[15302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:20.157796 15320 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:20.158623 15320 webserver.cc:460] Webserver started at http://127.25.214.254:35427/ using document root <none> and password file <none>
I20260807 05:02:20.159133 15320 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:20.159198 15320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:20.159379 15320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:20.161301 15320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "5458734200c844e49de76992fb592108"
format_stamp: "Formatted at 2026-08-07 05:02:20 on dist-test-slave-lgr5"
server_key: "d68f9ca2c053870be44ef97b1d67810b"
server_key_iv: "a08f92288f1d41da59d936e47e8ba641"
server_key_version: "encryptionkey@0"
I20260807 05:02:20.161832 15320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "5458734200c844e49de76992fb592108"
format_stamp: "Formatted at 2026-08-07 05:02:20 on dist-test-slave-lgr5"
server_key: "d68f9ca2c053870be44ef97b1d67810b"
server_key_iv: "a08f92288f1d41da59d936e47e8ba641"
server_key_version: "encryptionkey@0"
I20260807 05:02:20.165257 15320 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:02:20.167495 15345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:20.168646 15320 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:20.168757 15320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "5458734200c844e49de76992fb592108"
format_stamp: "Formatted at 2026-08-07 05:02:20 on dist-test-slave-lgr5"
server_key: "d68f9ca2c053870be44ef97b1d67810b"
server_key_iv: "a08f92288f1d41da59d936e47e8ba641"
server_key_version: "encryptionkey@0"
I20260807 05:02:20.168850 15320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:20.179800 15320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:20.182274 15320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:20.182436 15320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:20.190810 15320 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:33591
I20260807 05:02:20.190824 15412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:33591 every 8 connection(s)
I20260807 05:02:20.191677 15320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:20.194306 15414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:20.198400 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 15320
I20260807 05:02:20.198519 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:02:20.198781 26459 external_mini_cluster.cc:1428] Setting key fca5b688ea79ad21ce64d351374dab21
I20260807 05:02:20.199646 15414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108: Bootstrap starting.
I20260807 05:02:20.201839 15414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:20.202513 15414 log.cc:824] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:20.204212 15414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108: No bootstrap required, opened a new log
Aug 07 05:02:20 dist-test-slave-lgr5 krb5kdc[15302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:20.207775 15414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5458734200c844e49de76992fb592108" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33591 } }
I20260807 05:02:20.208027 15414 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:20.208103 15414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5458734200c844e49de76992fb592108, State: Initialized, Role: FOLLOWER
I20260807 05:02:20.208492 15414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5458734200c844e49de76992fb592108" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33591 } }
I20260807 05:02:20.208611 15414 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:20.208666 15414 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:20.208771 15414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:20.209508 15414 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5458734200c844e49de76992fb592108" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33591 } }
I20260807 05:02:20.209803 15414 leader_election.cc:302] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5458734200c844e49de76992fb592108; no voters:
I20260807 05:02:20.210080 15414 leader_election.cc:288] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:02:20.210172 15421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:20.210366 15421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [term 1 LEADER]: Becoming Leader. State: Replica: 5458734200c844e49de76992fb592108, State: Running, Role: LEADER
I20260807 05:02:20.210647 15421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5458734200c844e49de76992fb592108" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33591 } }
I20260807 05:02:20.211246 15414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:20.212159 15422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5458734200c844e49de76992fb592108" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5458734200c844e49de76992fb592108" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33591 } } }
I20260807 05:02:20.212278 15419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:20.199997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40854 (local address 127.25.214.254:33591)
0807 05:02:20.200420 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:20.200434 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:20.200468 (+ 34us) server_negotiation.cc:407] Connection header received
0807 05:02:20.201073 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:20.201101 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:20.201391 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:20.201672 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:20.202459 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:20.203420 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:20.204297 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:20.204739 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:20.204882 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:20.207419 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:20.207424 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:20.207435 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:20.207460 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:20.209175 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:20.209577 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:20.209583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:20.209589 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:20.209709 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:20.209987 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:20.209989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:20.209991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:20.210445 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:20.210625 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:20.211040 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 05:02:20.211333 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":125,"threads_started":1}
I20260807 05:02:20.212292 15422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:20.213303 15441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5458734200c844e49de76992fb592108. Latest consensus state: current_term: 1 leader_uuid: "5458734200c844e49de76992fb592108" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5458734200c844e49de76992fb592108" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33591 } } }
I20260807 05:02:20.213406 15441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:20.215278 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 05:02:20.216426 15442 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:02:20.216499 15442 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:02:20.216558 15444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:20.217346 15444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:20.222456 15444 catalog_manager.cc:1347] Generated new cluster ID: b356a4ecc2594af892ed582b0b7c7f7c
I20260807 05:02:20.222518 15444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:20.235826 15444 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:02:20.237040 15444 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:20.246752 15444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5458734200c844e49de76992fb592108: Generated new TSK 0
I20260807 05:02:20.247467 15444 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:02:20.272034 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 15320
2026-08-07T05:02:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1522 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:02:20 dist-test-slave-lgr5 krb5kdc[15454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:02:20 dist-test-slave-lgr5 krb5kdc[15454](info): set up 2 sockets
Aug 07 05:02:20 dist-test-slave-lgr5 krb5kdc[15454](info): commencing operation
krb5kdc: starting...
W20260807 05:02:21.431957 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:02:21 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:02:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:02:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:02:21.562539 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43641
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:21.677875 15476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:21.678174 15476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:21.678215 15476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:21.682446 15476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:21.682515 15476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:21.682534 15476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:21.682550 15476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:21.682564 15476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:21.687983 15476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:21.689078 15476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:21.690062 15476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:21.698302 15487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:21.698313 15484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:21.698312 15483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:21.698547 15476 server_base.cc:1034] running on GCE node
I20260807 05:02:21.699136 15476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:21.700259 15476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:21.701450 15476 hybrid_clock.cc:648] HybridClock initialized: now 1786078941701432 us; error 32 us; skew 500 ppm
Aug 07 05:02:21 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:21.704034 15476 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:21.704937 15476 webserver.cc:460] Webserver started at http://127.25.214.254:43763/ using document root <none> and password file <none>
I20260807 05:02:21.705451 15476 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:21.705508 15476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:21.705688 15476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:21.707760 15476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "45335e7e50a44327ac2e5b0799767e63"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "56e737e7695e5da9b1506ae64419c3da"
server_key_iv: "739aebfe8554e7ccf288d91d6012d934"
server_key_version: "encryptionkey@0"
I20260807 05:02:21.708339 15476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "45335e7e50a44327ac2e5b0799767e63"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "56e737e7695e5da9b1506ae64419c3da"
server_key_iv: "739aebfe8554e7ccf288d91d6012d934"
server_key_version: "encryptionkey@0"
I20260807 05:02:21.712003 15476 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:02:21.714403 15496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:21.715649 15476 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:21.715764 15476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "45335e7e50a44327ac2e5b0799767e63"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "56e737e7695e5da9b1506ae64419c3da"
server_key_iv: "739aebfe8554e7ccf288d91d6012d934"
server_key_version: "encryptionkey@0"
I20260807 05:02:21.715880 15476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:21.730801 15476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:21.733820 15476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:21.734011 15476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:21.741084 15476 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43641
I20260807 05:02:21.741354 15572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43641 every 8 connection(s)
I20260807 05:02:21.742125 15476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:21.744948 15574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:21.750075 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 15476
I20260807 05:02:21.750224 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:02:21.750509 26459 external_mini_cluster.cc:1428] Setting key 7ccd1dcd437477839b7a40cc6e33e9f0
I20260807 05:02:21.750860 15574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap starting.
I20260807 05:02:21.753391 15574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:21.754251 15574 log.cc:824] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:21.756498 15574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: No bootstrap required, opened a new log
Aug 07 05:02:21 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:21.760883 15574 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:21.761124 15574 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:21.761184 15574 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45335e7e50a44327ac2e5b0799767e63, State: Initialized, Role: FOLLOWER
I20260807 05:02:21.761675 15574 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:21.761818 15574 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:21.761886 15574 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:21.761989 15574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:21.763067 15574 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:21.763410 15574 leader_election.cc:302] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45335e7e50a44327ac2e5b0799767e63; no voters:
I20260807 05:02:21.763749 15574 leader_election.cc:288] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:02:21.763836 15579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:21.764112 15579 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 LEADER]: Becoming Leader. State: Replica: 45335e7e50a44327ac2e5b0799767e63, State: Running, Role: LEADER
I20260807 05:02:21.764434 15579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:21.765112 15574 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:21.765594 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:21.752009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37812 (local address 127.25.214.254:43641)
0807 05:02:21.752484 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:21.752500 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:21.752537 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:02:21.753205 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:21.753223 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:21.753584 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:21.753877 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:21.754799 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:21.755930 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:21.757100 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:21.757568 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:21.757682 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:21.760495 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:21.760501 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:21.760514 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:21.760541 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:21.762262 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:21.762702 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:21.762707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:21.762712 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:21.762823 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:21.763105 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:21.763107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:21.763108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:21.763557 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:21.763746 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:21.764146 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 05:02:21.764610 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":136,"threads_started":1}
I20260807 05:02:21.765996 15582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45335e7e50a44327ac2e5b0799767e63. Latest consensus state: current_term: 1 leader_uuid: "45335e7e50a44327ac2e5b0799767e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } } }
I20260807 05:02:21.766120 15582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:21.767028 15580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45335e7e50a44327ac2e5b0799767e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } } }
I20260807 05:02:21.767130 15580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: This master's current role is: LEADER
W20260807 05:02:21.770246 15607 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:02:21.770330 15607 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:02:21.770387 15591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:21.771239 15591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:21.776894 15591 catalog_manager.cc:1347] Generated new cluster ID: 1da68071d7b24b7085979c79dfdfb1ae
I20260807 05:02:21.777019 15591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:21.786520 15591 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:02:21.787789 15591 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:21.799898 15591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Generated new TSK 0
I20260807 05:02:21.800926 15591 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:02:21.836907 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43641
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:21.953423 15618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:21.953729 15618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:21.953794 15618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:21.957942 15618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:21.958019 15618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:21.958102 15618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:02:21.963642 15618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:21.964932 15618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:21.966132 15618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:21.977566 15631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:21.977564 15632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:21.977890 15635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:21.977924 15618 server_base.cc:1034] running on GCE node
I20260807 05:02:21.978643 15618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:21.979437 15618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:21.980630 15618 hybrid_clock.cc:648] HybridClock initialized: now 1786078941980591 us; error 57 us; skew 500 ppm
Aug 07 05:02:21 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:21.983908 15618 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:02:21.985009 15618 webserver.cc:460] Webserver started at http://127.25.214.193:41389/ using document root <none> and password file <none>
I20260807 05:02:21.985718 15618 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:21.985818 15618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:21.986085 15618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:21.988432 15618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "894f071dee4abbaa2d4f29aeaa7b06ff"
server_key_iv: "ba40adfe8c96c2dc7b9547b57367877c"
server_key_version: "encryptionkey@0"
I20260807 05:02:21.989001 15618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "894f071dee4abbaa2d4f29aeaa7b06ff"
server_key_iv: "ba40adfe8c96c2dc7b9547b57367877c"
server_key_version: "encryptionkey@0"
I20260807 05:02:21.992820 15618 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:02:21.995312 15642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:21.996649 15618 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 05:02:21.996762 15618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "894f071dee4abbaa2d4f29aeaa7b06ff"
server_key_iv: "ba40adfe8c96c2dc7b9547b57367877c"
server_key_version: "encryptionkey@0"
I20260807 05:02:21.996874 15618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:22.008570 15618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:22.011947 15618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:22.012185 15618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:22.012805 15618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:22.013666 15618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:22.013712 15618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.013758 15618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:22.013787 15618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.022351 15618 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:32917
I20260807 05:02:22.022413 15843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:32917 every 8 connection(s)
I20260807 05:02:22.023267 15618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:02:22.024763 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 15618
I20260807 05:02:22.024894 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:02:22.025228 26459 external_mini_cluster.cc:1428] Setting key a3652d37c46091800765038480512cd5
Aug 07 05:02:22 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:02:22.037879 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.025220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46035 (local address 127.25.214.254:43641)
0807 05:02:22.025378 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.025382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.026307 (+ 925us) server_negotiation.cc:407] Connection header received
0807 05:02:22.027957 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.027959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.028004 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.028068 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:22.029527 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.030306 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.031423 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.031759 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.031891 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.034484 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:22.034488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:22.034490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:22.034516 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:22.035917 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.036450 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.036453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.036455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.036546 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.036838 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.036840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.036841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.037032 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:22.037104 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.037631 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.037745 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 05:02:22.038691 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.025611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:46035)
0807 05:02:22.026141 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.026199 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.027720 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.028295 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.028303 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.028787 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:22.029362 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.029376 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.030415 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.030417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.031304 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.031313 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.031901 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.031904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.032056 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.032706 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:22.032723 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:22.034294 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:22.036037 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:22.036042 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:22.036057 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:22.036345 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:22.036626 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:22.036628 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:22.036630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:22.036765 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:22.037111 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:22.037116 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:22.037375 (+ 259us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.037535 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.037803 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":153,"threads_started":1}
I20260807 05:02:22.039983 15845 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43641
I20260807 05:02:22.040297 15845 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:22.040822 15845 heartbeater.cc:511] Master 127.25.214.254:43641 requested a full tablet report, sending...
I20260807 05:02:22.042490 15524 ts_manager.cc:194] Registered new tserver with Master: fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917)
I20260807 05:02:22.043927 15524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:46035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:02:22.055086 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43641
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:22.172413 15851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:22.172806 15851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:22.172880 15851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:22.176927 15851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:22.176998 15851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:22.177062 15851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:02:22.182404 15851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:22.183470 15851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:22.184537 15851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:22.194284 15859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:22.194458 15851 server_base.cc:1034] running on GCE node
W20260807 05:02:22.194306 15860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:22.194293 15864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:22.194993 15851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:22.195658 15851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:22.196836 15851 hybrid_clock.cc:648] HybridClock initialized: now 1786078942196808 us; error 38 us; skew 500 ppm
Aug 07 05:02:22 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:22.199522 15851 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:02:22.200446 15851 webserver.cc:460] Webserver started at http://127.25.214.194:45557/ using document root <none> and password file <none>
I20260807 05:02:22.200982 15851 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:22.201057 15851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:22.201256 15851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:22.203302 15851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "e18745e30ce1467797b7c067f7022713"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "19b4148adc7fc35dbc266496a0dc8679"
server_key_iv: "f04dec9a44a5986d4572384b8449401c"
server_key_version: "encryptionkey@0"
I20260807 05:02:22.203822 15851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "e18745e30ce1467797b7c067f7022713"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "19b4148adc7fc35dbc266496a0dc8679"
server_key_iv: "f04dec9a44a5986d4572384b8449401c"
server_key_version: "encryptionkey@0"
I20260807 05:02:22.207451 15851 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:22.209808 15873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.210947 15851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 05:02:22.211045 15851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "e18745e30ce1467797b7c067f7022713"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "19b4148adc7fc35dbc266496a0dc8679"
server_key_iv: "f04dec9a44a5986d4572384b8449401c"
server_key_version: "encryptionkey@0"
I20260807 05:02:22.211138 15851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:22.223785 15851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:22.226818 15851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:22.227002 15851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:22.227576 15851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:22.228457 15851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:22.228507 15851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.228551 15851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:22.228579 15851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.237488 15851 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:38781
I20260807 05:02:22.237514 16050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:38781 every 8 connection(s)
I20260807 05:02:22.238404 15851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:02:22.242591 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 15851
I20260807 05:02:22.242743 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:02:22.243077 26459 external_mini_cluster.cc:1428] Setting key 339e3ea0f655e977960c4ebc8af6ac53
Aug 07 05:02:22 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:22.253417 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.240301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:35729 (local address 127.25.214.254:43641)
0807 05:02:22.240455 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.240460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.241496 (+ 1036us) server_negotiation.cc:407] Connection header received
0807 05:02:22.243063 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.243066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.243124 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.243227 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:22.244566 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.245089 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.246269 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.246492 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.246588 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.249150 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:22.249154 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:22.249157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:22.249187 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:22.250680 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.251210 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.251213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.251215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.251306 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.251747 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.251751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.251753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.252003 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:22.252145 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.252915 (+ 770us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.253151 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:02:22.254295 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.240804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:35729)
0807 05:02:22.241317 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.241372 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.242767 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.243447 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.243455 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.243835 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:22.244403 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.244418 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.245220 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.245223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.246128 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.246151 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.246641 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.246646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.246822 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.247400 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:22.247417 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:22.248961 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:22.250798 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:22.250802 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:22.250815 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:22.251072 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:22.251413 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:22.251416 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:22.251418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:22.251597 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:22.252164 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:22.252203 (+ 39us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:22.252574 (+ 371us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.252790 (+ 216us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.253168 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":132,"threads_started":1}
I20260807 05:02:22.255483 16053 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43641
I20260807 05:02:22.255734 16053 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:22.256307 16053 heartbeater.cc:511] Master 127.25.214.254:43641 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 05:02:22.257478 15524 ts_manager.cc:194] Registered new tserver with Master: e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781)
I20260807 05:02:22.258042 15524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:35729
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:02:22.272567 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43641
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:22.390442 16061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:22.390740 16061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:22.390785 16061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:22.394889 16061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:22.394963 16061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:22.395025 16061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:02:22.400858 16061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:22.401978 16061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:22.403046 16061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:22.412636 16071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:22.412659 16073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:22.412645 16068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:22.412842 16061 server_base.cc:1034] running on GCE node
I20260807 05:02:22.413311 16061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:22.413965 16061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:22.415154 16061 hybrid_clock.cc:648] HybridClock initialized: now 1786078942415126 us; error 37 us; skew 500 ppm
Aug 07 05:02:22 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:22.418058 16061 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:02:22.419075 16061 webserver.cc:460] Webserver started at http://127.25.214.195:41237/ using document root <none> and password file <none>
I20260807 05:02:22.419638 16061 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:22.419709 16061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:22.419956 16061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:22.422075 16061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "08768d4128944ca9826000c79a49edf8"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "7732d936e0a60478d5fa54b92dc39ee7"
server_key_iv: "d5e07109c65687d98984dd6068be1635"
server_key_version: "encryptionkey@0"
I20260807 05:02:22.422636 16061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "08768d4128944ca9826000c79a49edf8"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "7732d936e0a60478d5fa54b92dc39ee7"
server_key_iv: "d5e07109c65687d98984dd6068be1635"
server_key_version: "encryptionkey@0"
I20260807 05:02:22.426472 16061 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:02:22.428984 16088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.430295 16061 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:02:22.430419 16061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "08768d4128944ca9826000c79a49edf8"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "7732d936e0a60478d5fa54b92dc39ee7"
server_key_iv: "d5e07109c65687d98984dd6068be1635"
server_key_version: "encryptionkey@0"
I20260807 05:02:22.430531 16061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:22.459482 16061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:22.462795 16061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:22.462999 16061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:22.463647 16061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:22.464577 16061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:22.464627 16061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.464681 16061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:22.464709 16061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:22.473840 16061 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:35803
I20260807 05:02:22.473874 16272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:35803 every 8 connection(s)
I20260807 05:02:22.474795 16061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:02:22.480043 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 16061
I20260807 05:02:22.480191 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:02:22.480472 26459 external_mini_cluster.cc:1428] Setting key 5d18f31cca8c2e52ffd07e9307e9b4cd
Aug 07 05:02:22 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:22.488675 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.476866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:37159 (local address 127.25.214.254:43641)
0807 05:02:22.477043 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.477047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.477954 (+ 907us) server_negotiation.cc:407] Connection header received
0807 05:02:22.479361 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.479364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.479427 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.479514 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:22.480841 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.481443 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.482598 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.482810 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.482904 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.485346 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:22.485349 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:22.485351 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:22.485378 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:22.486647 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.487151 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.487154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.487155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.487234 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.487566 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.487569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.487571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.487751 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:22.487837 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.488384 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.488510 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 05:02:22.489580 16276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.477251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:37159)
0807 05:02:22.477778 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.477827 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.479140 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.479703 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.479710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.480111 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:22.480693 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.480709 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.481566 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.481569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.482472 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.482482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.482958 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.482962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.483127 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.483706 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:22.483722 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:22.485185 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:22.486770 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:22.486776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:22.486792 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:22.487054 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:22.487316 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:22.487319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:22.487321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:22.487474 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:22.487851 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:22.487858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:22.488152 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.488328 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.488672 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":134,"threads_started":1}
I20260807 05:02:22.490620 16273 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43641
I20260807 05:02:22.490859 16273 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:22.491362 16273 heartbeater.cc:511] Master 127.25.214.254:43641 requested a full tablet report, sending...
I20260807 05:02:22.492372 15524 ts_manager.cc:194] Registered new tserver with Master: 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
I20260807 05:02:22.493011 15524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:37159
I20260807 05:02:22.494278 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:02:22.502727 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.496173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37818 (local address 127.25.214.254:43641)
0807 05:02:22.496295 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.496299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.496448 (+ 149us) server_negotiation.cc:407] Connection header received
0807 05:02:22.496544 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.496546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.496586 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.496646 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:22.497248 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.497743 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.498509 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.498715 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.498800 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.500100 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:22.500105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:22.500108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:22.500134 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:22.501289 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.501681 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.501683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.501685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.501754 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:22.502000 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:22.502003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:22.502004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:22.502221 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:22.502330 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.502480 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.502577 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 05:02:22.505448 15523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37818:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:02:22.508414 15523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:02:22.523052 16296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.517915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39152 (local address 127.25.214.193:32917)
0807 05:02:22.518203 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.518220 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.518622 (+ 402us) server_negotiation.cc:407] Connection header received
0807 05:02:22.518722 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.518726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.518895 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.519042 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:22.519352 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.520349 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.521723 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.522347 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.522483 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.522619 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.522789 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.522888 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":106,"threads_started":1}
I20260807 05:02:22.523053 16287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.517475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:32917 (local address 127.0.0.1:39152)
0807 05:02:22.518518 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.518529 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.518610 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.519105 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.519108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.519121 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:22.519232 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.519238 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.520514 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.520518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.521597 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.521608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.522480 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.522483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.522592 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.522634 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.522753 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.522879 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":982,"mutex_wait_us":76,"thread_start_us":90,"threads_started":1}
I20260807 05:02:22.523624 16289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.516768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:35803 (local address 127.0.0.1:48630)
0807 05:02:22.518090 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.518147 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.518302 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.519022 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.519025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.519042 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:22.519193 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.519200 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.520678 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.520682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.522085 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.522097 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.523254 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.523257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.523339 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.523362 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.523423 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.523487 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"mutex_wait_us":85,"thread_start_us":77,"threads_started":1}
I20260807 05:02:22.523941 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.517567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34660 (local address 127.25.214.194:38781)
0807 05:02:22.518118 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.518131 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.518343 (+ 212us) server_negotiation.cc:407] Connection header received
0807 05:02:22.518483 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.518487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.518694 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.518842 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:22.519245 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.520518 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.522215 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.522987 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.523105 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.523231 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.523692 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.523789 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":125,"threads_started":1}
I20260807 05:02:22.524143 16291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.517172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48630 (local address 127.25.214.195:35803)
0807 05:02:22.517553 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.517568 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.518254 (+ 686us) server_negotiation.cc:407] Connection header received
0807 05:02:22.518477 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.518483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.518694 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.518859 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:22.519302 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.520530 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.522229 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.522953 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.523065 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.523183 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.523882 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.523977 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":123,"threads_started":1}
I20260807 05:02:22.524367 16294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.516918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:38781 (local address 127.0.0.1:34660)
0807 05:02:22.518260 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.518274 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.518376 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.518846 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.518852 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.518883 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:22.519125 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.519136 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.520678 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.520682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.522087 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.522097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.523299 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.523302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.523390 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.523413 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.523483 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.523557 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1276,"mutex_wait_us":232,"thread_start_us":122,"threads_started":1}
I20260807 05:02:22.526742 16169 tablet_service.cc:1467] Processing CreateTablet for tablet e305892afd6a4b05bef32466266c8085 (DEFAULT_TABLE table=test-table [id=2791dea288134a7ca6b9590e26be0098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:22.526840 15959 tablet_service.cc:1467] Processing CreateTablet for tablet e305892afd6a4b05bef32466266c8085 (DEFAULT_TABLE table=test-table [id=2791dea288134a7ca6b9590e26be0098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:22.526840 15727 tablet_service.cc:1467] Processing CreateTablet for tablet e305892afd6a4b05bef32466266c8085 (DEFAULT_TABLE table=test-table [id=2791dea288134a7ca6b9590e26be0098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:22.527804 16169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e305892afd6a4b05bef32466266c8085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:22.527902 15727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e305892afd6a4b05bef32466266c8085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:22.527905 15959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e305892afd6a4b05bef32466266c8085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:22.534107 16297 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Bootstrap starting.
I20260807 05:02:22.536108 16298 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Bootstrap starting.
I20260807 05:02:22.536911 16297 tablet_bootstrap.cc:654] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:22.536988 16301 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap starting.
I20260807 05:02:22.537690 16297 log.cc:824] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:22.538722 16298 tablet_bootstrap.cc:654] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:22.539592 16297 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: No bootstrap required, opened a new log
I20260807 05:02:22.539554 16298 log.cc:824] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:22.539654 16301 tablet_bootstrap.cc:654] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:22.539789 16297 ts_tablet_manager.cc:1397] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:02:22.540447 16301 log.cc:824] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:22.541716 16298 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: No bootstrap required, opened a new log
I20260807 05:02:22.541915 16298 ts_tablet_manager.cc:1397] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:02:22.542069 16301 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: No bootstrap required, opened a new log
I20260807 05:02:22.542241 16301 ts_tablet_manager.cc:1397] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:02:22.543658 16297 raft_consensus.cc:348] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.543962 16297 raft_consensus.cc:374] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:22.544019 16297 raft_consensus.cc:729] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08768d4128944ca9826000c79a49edf8, State: Initialized, Role: FOLLOWER
I20260807 05:02:22.544508 16297 consensus_queue.cc:260] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.545303 16273 heartbeater.cc:503] Master 127.25.214.254:43641 was elected leader, sending a full tablet report...
I20260807 05:02:22.545617 16297 ts_tablet_manager.cc:1428] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 05:02:22.545630 16301 raft_consensus.cc:348] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.545688 16298 raft_consensus.cc:348] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.545862 16301 raft_consensus.cc:374] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:22.545919 16301 raft_consensus.cc:729] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdcc9fd35317493aaefe5e7ac4da08c2, State: Initialized, Role: FOLLOWER
I20260807 05:02:22.545926 16298 raft_consensus.cc:374] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:22.546209 16298 raft_consensus.cc:729] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e18745e30ce1467797b7c067f7022713, State: Initialized, Role: FOLLOWER
I20260807 05:02:22.546368 16301 consensus_queue.cc:260] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.546629 16298 consensus_queue.cc:260] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.547416 16301 ts_tablet_manager.cc:1428] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 05:02:22.547533 16298 ts_tablet_manager.cc:1428] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 05:02:22.547858 15845 heartbeater.cc:503] Master 127.25.214.254:43641 was elected leader, sending a full tablet report...
I20260807 05:02:22.547868 16053 heartbeater.cc:503] Master 127.25.214.254:43641 was elected leader, sending a full tablet report...
I20260807 05:02:22.704607 16309 raft_consensus.cc:482] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:22.704833 16309 raft_consensus.cc:504] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.706635 16309 leader_election.cc:288] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803), fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917)
I20260807 05:02:22.710305 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.706374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:35803 (local address 127.25.214.194:55651)
0807 05:02:22.706515 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.706530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.706618 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.706933 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.706937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.706962 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:22.707086 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.707093 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.708052 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.708055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.709057 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.709067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.709867 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.709880 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.709985 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.710012 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.710090 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.710160 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 05:02:22.710337 16291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.706516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:55651 (local address 127.25.214.195:35803)
0807 05:02:22.706652 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.706658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.706695 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:02:22.706754 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.706757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.706808 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.706877 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:22.707224 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.707948 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.709181 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.709766 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.709855 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.709896 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.710147 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.710217 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:02:22.710788 16310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.706877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:32917 (local address 127.25.214.194:38855)
0807 05:02:22.707236 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.707249 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:22.707349 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:22.707553 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:22.707555 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:22.707587 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:22.707710 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.707716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.708632 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.708635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.709573 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:22.709584 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.710386 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.710390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:22.710487 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.710510 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:02:22.710598 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 05:02:22.710660 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
I20260807 05:02:22.710803 16296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.707012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:38855 (local address 127.25.214.193:32917)
0807 05:02:22.707135 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.707140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.707326 (+ 186us) server_negotiation.cc:407] Connection header received
0807 05:02:22.707425 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.707427 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.707471 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.707531 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:22.707805 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.708502 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.709699 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.710229 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.710338 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.710395 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.710622 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.710693 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:02:22.710983 16203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e305892afd6a4b05bef32466266c8085" candidate_uuid: "e18745e30ce1467797b7c067f7022713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08768d4128944ca9826000c79a49edf8" is_pre_election: true
I20260807 05:02:22.711293 16203 raft_consensus.cc:2454] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e18745e30ce1467797b7c067f7022713 in term 0.
I20260807 05:02:22.711436 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e305892afd6a4b05bef32466266c8085" candidate_uuid: "e18745e30ce1467797b7c067f7022713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" is_pre_election: true
I20260807 05:02:22.711706 15763 raft_consensus.cc:2454] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e18745e30ce1467797b7c067f7022713 in term 0.
I20260807 05:02:22.711746 15877 leader_election.cc:302] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08768d4128944ca9826000c79a49edf8, e18745e30ce1467797b7c067f7022713; no voters:
I20260807 05:02:22.712005 16309 raft_consensus.cc:2781] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:02:22.712110 16309 raft_consensus.cc:482] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:02:22.712164 16309 raft_consensus.cc:3037] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:22.713228 16309 raft_consensus.cc:504] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.713531 16309 leader_election.cc:288] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [CANDIDATE]: Term 1 election: Requested vote from peers 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803), fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917)
I20260807 05:02:22.713843 16203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e305892afd6a4b05bef32466266c8085" candidate_uuid: "e18745e30ce1467797b7c067f7022713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08768d4128944ca9826000c79a49edf8"
I20260807 05:02:22.713894 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e305892afd6a4b05bef32466266c8085" candidate_uuid: "e18745e30ce1467797b7c067f7022713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
I20260807 05:02:22.713971 16203 raft_consensus.cc:3037] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:22.713985 15763 raft_consensus.cc:3037] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:22.715253 15763 raft_consensus.cc:2454] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e18745e30ce1467797b7c067f7022713 in term 1.
I20260807 05:02:22.715253 16203 raft_consensus.cc:2454] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e18745e30ce1467797b7c067f7022713 in term 1.
I20260807 05:02:22.715529 15877 leader_election.cc:302] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e18745e30ce1467797b7c067f7022713, fdcc9fd35317493aaefe5e7ac4da08c2; no voters:
I20260807 05:02:22.715763 16309 raft_consensus.cc:2781] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:22.715937 16309 raft_consensus.cc:686] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 1 LEADER]: Becoming Leader. State: Replica: e18745e30ce1467797b7c067f7022713, State: Running, Role: LEADER
I20260807 05:02:22.716251 16309 consensus_queue.cc:237] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:22.719399 15523 catalog_manager.cc:5495] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 reported cstate change: term changed from 0 to 1, leader changed from <none> to e18745e30ce1467797b7c067f7022713 (127.25.214.194). New cstate: current_term: 1 leader_uuid: "e18745e30ce1467797b7c067f7022713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
W20260807 05:02:22.725823 16274 tablet.cc:2369] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:02:22.739486 16054 tablet.cc:2369] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:02:22.759796 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.756608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34668 (local address 127.25.214.194:38781)
0807 05:02:22.756760 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:22.756763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:22.756778 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:02:22.756880 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:22.756882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:22.756940 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:22.757031 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:02:22.757211 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.757711 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.758511 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:22.758722 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:22.758790 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:22.759025 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:02:22.759468 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:02:22.759568 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:22.759593 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 05:02:22.759648 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 05:02:22.765908 16203 raft_consensus.cc:1261] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Refusing update from remote peer e18745e30ce1467797b7c067f7022713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:22.765909 15763 raft_consensus.cc:1261] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Refusing update from remote peer e18745e30ce1467797b7c067f7022713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:22.766692 16312 consensus_queue.cc:1035] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:22.766880 16309 consensus_queue.cc:1035] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 05:02:22.774591 15846 tablet.cc:2369] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:02:22.775465 16317 mvcc.cc:205] Tried to move back new op lower bound from 7315779349561053184 to 7315779349368266752. Current Snapshot: MvccSnapshot[applied={T|T < 7315779349561053184}]
I20260807 05:02:22.776037 16319 mvcc.cc:205] Tried to move back new op lower bound from 7315779349561053184 to 7315779349368266752. Current Snapshot: MvccSnapshot[applied={T|T < 7315779349561053184}]
I20260807 05:02:22.784036 15522 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:22.784263 15522 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:22.786818 15522 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Sending DeleteTablet for 3 replicas of tablet e305892afd6a4b05bef32466266c8085
I20260807 05:02:22.787670 15959 tablet_service.cc:1514] Processing DeleteTablet for tablet e305892afd6a4b05bef32466266c8085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:22 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:34660
I20260807 05:02:22.787734 15727 tablet_service.cc:1514] Processing DeleteTablet for tablet e305892afd6a4b05bef32466266c8085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:22 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:39152
I20260807 05:02:22.787783 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 15618
I20260807 05:02:22.787953 16169 tablet_service.cc:1514] Processing DeleteTablet for tablet e305892afd6a4b05bef32466266c8085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:22 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:48630
I20260807 05:02:22.796308 16329 tablet_replica.cc:330] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: stopping tablet replica
I20260807 05:02:22.796700 16329 raft_consensus.cc:2229] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:02:22.797186 16329 raft_consensus.cc:2258] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:22.798857 16329 ts_tablet_manager.cc:1905] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:22.800352 16332 tablet_replica.cc:330] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: stopping tablet replica
I20260807 05:02:22.800791 16332 raft_consensus.cc:2229] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:22.801246 16332 raft_consensus.cc:2258] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:22.801837 16329 ts_tablet_manager.cc:1918] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:22.801949 16329 log.cc:1196] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/e305892afd6a4b05bef32466266c8085
I20260807 05:02:22.802261 16329 ts_tablet_manager.cc:1939] T e305892afd6a4b05bef32466266c8085 P e18745e30ce1467797b7c067f7022713: Deleting consensus metadata
I20260807 05:02:22.803215 16332 ts_tablet_manager.cc:1905] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:22.803787 15500 catalog_manager.cc:4841] TS e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): tablet e305892afd6a4b05bef32466266c8085 (table test-table [id=2791dea288134a7ca6b9590e26be0098]) successfully deleted
W20260807 05:02:22.803828 15501 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:32917 (error 108)
I20260807 05:02:22.804731 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 15851
I20260807 05:02:22.805469 16287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:22.804563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:32917 (local address 127.0.0.1:39160)
0807 05:02:22.805297 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:22.805375 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:32917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":637}
I20260807 05:02:22.808724 16332 ts_tablet_manager.cc:1918] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:22.808809 16332 log.cc:1196] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/e305892afd6a4b05bef32466266c8085
I20260807 05:02:22.809087 16332 ts_tablet_manager.cc:1939] T e305892afd6a4b05bef32466266c8085 P 08768d4128944ca9826000c79a49edf8: Deleting consensus metadata
W20260807 05:02:22.823122 15501 catalog_manager.cc:4584] TS fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e305892afd6a4b05bef32466266c8085: Network error: Client connection negotiation failed: client connection to 127.25.214.193:32917: connect: Connection refused (error 111)
I20260807 05:02:22.823426 15501 catalog_manager.cc:4841] TS 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): tablet e305892afd6a4b05bef32466266c8085 (table test-table [id=2791dea288134a7ca6b9590e26be0098]) successfully deleted
I20260807 05:02:22.828419 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 16061
I20260807 05:02:22.838649 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 15476
I20260807 05:02:22.852140 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43641
--webserver_interface=127.25.214.254
--webserver_port=43763
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:22.963498 16335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:22.963764 16335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:22.963804 16335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:22.967650 16335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:22.967700 16335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:22.967717 16335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:22.967732 16335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:22.967751 16335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:22.972924 16335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=43763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:22.973909 16335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:22.974857 16335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:02:22.988794 16335 server_base.cc:1034] running on GCE node
W20260807 05:02:22.988744 16347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:22.988755 16346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:22.988735 16352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:22.989689 16335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:22.991010 16335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:22.992146 16335 hybrid_clock.cc:648] HybridClock initialized: now 1786078942992127 us; error 36 us; skew 500 ppm
Aug 07 05:02:22 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:23.003408 16335 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:23.004907 16335 webserver.cc:460] Webserver started at http://127.25.214.254:43763/ using document root <none> and password file <none>
I20260807 05:02:23.005698 16335 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:23.005808 16335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:23.011128 16335 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 05:02:23.013989 16363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.015545 16335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:23.015688 16335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "45335e7e50a44327ac2e5b0799767e63"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "56e737e7695e5da9b1506ae64419c3da"
server_key_iv: "739aebfe8554e7ccf288d91d6012d934"
server_key_version: "encryptionkey@0"
I20260807 05:02:23.016535 16335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:23.036021 16335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:23.039179 16335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:23.039366 16335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:23.046561 16335 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43641
I20260807 05:02:23.046911 16450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43641 every 8 connection(s)
I20260807 05:02:23.047753 16335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:23.051625 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 16335
I20260807 05:02:23.052058 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:32917
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:43641
--webserver_port=41389
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:23.053866 16451 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:02:23.056217 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap starting.
I20260807 05:02:23.079502 16451 log.cc:824] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:23.091562 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:02:23.092029 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap complete.
I20260807 05:02:23.098042 16451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:23.098619 16451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45335e7e50a44327ac2e5b0799767e63, State: Initialized, Role: FOLLOWER
I20260807 05:02:23.099237 16451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:23.099390 16451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:23.099465 16451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:23.099567 16451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 05:02:23.102339 16451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:23.102734 16451 leader_election.cc:302] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45335e7e50a44327ac2e5b0799767e63; no voters:
I20260807 05:02:23.103133 16451 leader_election.cc:288] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 05:02:23.103317 16457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 05:02:23.103622 16457 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 LEADER]: Becoming Leader. State: Replica: 45335e7e50a44327ac2e5b0799767e63, State: Running, Role: LEADER
I20260807 05:02:23.103977 16457 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:23.104540 16451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:23.105540 16459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45335e7e50a44327ac2e5b0799767e63. Latest consensus state: current_term: 2 leader_uuid: "45335e7e50a44327ac2e5b0799767e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } } }
I20260807 05:02:23.105660 16459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:23.106323 16458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "45335e7e50a44327ac2e5b0799767e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } } }
I20260807 05:02:23.106420 16458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:23.109647 16479 catalog_manager.cc:1259] Loaded cluster ID: 1da68071d7b24b7085979c79dfdfb1ae
I20260807 05:02:23.109705 16479 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: loading cluster ID for follower catalog manager: success
W20260807 05:02:23.110690 16479 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260807 05:02:23.110765 16479 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260807 05:02:23.110826 16468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:23.113328 16468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:23.113840 16468 catalog_manager.cc:1259] Loaded cluster ID: 1da68071d7b24b7085979c79dfdfb1ae
I20260807 05:02:23.113901 16468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:23.114936 16468 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 05:02:23.119738 16468 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 05:02:23.125629 16468 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:23.126395 16468 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Loaded TSK: 0
I20260807 05:02:23.127682 16468 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 05:02:23.192207 16453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:23.192577 16453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:23.192651 16453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:23.198566 16453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:23.198657 16453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:23.198750 16453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:02:23.206434 16453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:32917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=41389
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:23.207860 16453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:23.209214 16453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:23.220270 16489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:23.220323 16487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:23.220270 16499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:23.220768 16453 server_base.cc:1034] running on GCE node
I20260807 05:02:23.221200 16453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:23.221954 16453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:23.223140 16453 hybrid_clock.cc:648] HybridClock initialized: now 1786078943223110 us; error 49 us; skew 500 ppm
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078943, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:23.226112 16453 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:02:23.227116 16453 webserver.cc:460] Webserver started at http://127.25.214.193:41389/ using document root <none> and password file <none>
I20260807 05:02:23.227692 16453 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:23.227770 16453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:23.231752 16453 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:02:23.234046 16508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.235387 16453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:23.235512 16453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "894f071dee4abbaa2d4f29aeaa7b06ff"
server_key_iv: "ba40adfe8c96c2dc7b9547b57367877c"
server_key_version: "encryptionkey@0"
I20260807 05:02:23.236059 16453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:23.263236 16453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:23.266604 16453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:23.266805 16453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:23.267449 16453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:23.268654 16519 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 05:02:23.273087 16453 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 05:02:23.273159 16453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260807 05:02:23.273223 16453 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 05:02:23.275031 16453 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 05:02:23.275113 16453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 05:02:23.275415 16519 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap starting.
I20260807 05:02:23.285861 16680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:32917 every 8 connection(s)
I20260807 05:02:23.285861 16453 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:32917
I20260807 05:02:23.287226 16453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:02:23.293917 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 16453
I20260807 05:02:23.294418 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:38781
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:43641
--webserver_port=45557
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:23.299206 16519 log.cc:824] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Log is configured to *not* fsync() on all Append() calls
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078943, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:23.306852 16685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.289308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:56769)
0807 05:02:23.289933 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.290009 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.291180 (+ 1171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.292321 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.292330 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.292860 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:23.293632 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.293655 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.295482 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.295485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.296706 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.296718 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.297649 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.297653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.297880 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.298594 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:23.298616 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:23.300426 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:23.303167 (+ 2741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.303173 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.303188 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.303545 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.303989 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.303992 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.303994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.304206 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.304950 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:23.304956 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:23.305264 (+ 308us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.305466 (+ 202us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.305853 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":166,"threads_started":1}
I20260807 05:02:23.308702 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.289470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:56769 (local address 127.25.214.254:43641)
0807 05:02:23.289928 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.289952 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.290141 (+ 189us) server_negotiation.cc:407] Connection header received
0807 05:02:23.291614 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.291625 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.291909 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.292209 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:23.293843 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.295271 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.296830 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.297338 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.297699 (+ 361us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.300729 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:23.300735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:23.300751 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:23.300792 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:23.302966 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.303685 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.303692 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.303698 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.303868 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.304307 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.304311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.304313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.304823 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:23.304979 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.307570 (+ 2591us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.307872 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":108,"threads_started":1}
I20260807 05:02:23.308985 16519 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:02:23.309329 16519 tablet_bootstrap.cc:492] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap complete.
I20260807 05:02:23.310513 16519 ts_tablet_manager.cc:1397] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent bootstrapping tablet: real 0.035s user 0.025s sys 0.005s
I20260807 05:02:23.311198 16682 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43641
I20260807 05:02:23.311437 16682 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:23.311996 16682 heartbeater.cc:511] Master 127.25.214.254:43641 requested a full tablet report, sending...
I20260807 05:02:23.313243 16519 raft_consensus.cc:348] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.313735 16519 raft_consensus.cc:729] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdcc9fd35317493aaefe5e7ac4da08c2, State: Initialized, Role: FOLLOWER
I20260807 05:02:23.314172 16519 consensus_queue.cc:260] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.314826 16393 ts_manager.cc:194] Registered new tserver with Master: fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917)
I20260807 05:02:23.315022 16519 ts_tablet_manager.cc:1428] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20260807 05:02:23.318706 16393 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:56769
I20260807 05:02:23.321379 16682 heartbeater.cc:503] Master 127.25.214.254:43641 was elected leader, sending a full tablet report...
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 05:02:23.328203 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.318062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:32917 (local address 127.0.0.1:39164)
0807 05:02:23.318742 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.318777 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.318916 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.319390 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.319395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.319815 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:23.319925 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.319931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.320985 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.320988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.321753 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.321766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.322502 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.322506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.322630 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.323243 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:23.323255 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:23.324777 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:23.326663 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.326672 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.326676 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.326893 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.327166 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.327168 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.327170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.327240 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.327682 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:23.327686 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:23.327783 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.327887 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.328028 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":121,"threads_started":1}
I20260807 05:02:23.328332 16695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.318124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39164 (local address 127.25.214.193:32917)
0807 05:02:23.318495 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.318506 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.319025 (+ 519us) server_negotiation.cc:407] Connection header received
0807 05:02:23.319088 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.319091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.319244 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.319358 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:23.320044 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.320873 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.321874 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.322358 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.322461 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.324920 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:23.324930 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:23.324942 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:23.324969 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:23.326561 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.326992 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.326997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.326999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.327087 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.327312 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.327314 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.327316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.327586 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:23.327715 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.327988 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.328171 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":277,"thread_start_us":81,"threads_started":1}
I20260807 05:02:23.329296 16586 tablet_service.cc:1514] Processing DeleteTablet for tablet e305892afd6a4b05bef32466266c8085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:22 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:39164
I20260807 05:02:23.330098 16697 tablet_replica.cc:330] stopping tablet replica
I20260807 05:02:23.330369 16697 raft_consensus.cc:2229] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:23.330590 16697 raft_consensus.cc:2258] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:23.331521 16697 ts_tablet_manager.cc:1905] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:23.334887 16697 ts_tablet_manager.cc:1918] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:23.334975 16697 log.cc:1196] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/e305892afd6a4b05bef32466266c8085
I20260807 05:02:23.335232 16697 ts_tablet_manager.cc:1939] T e305892afd6a4b05bef32466266c8085 P fdcc9fd35317493aaefe5e7ac4da08c2: Deleting consensus metadata
I20260807 05:02:23.336799 16367 catalog_manager.cc:4841] TS fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917): tablet e305892afd6a4b05bef32466266c8085 (table test-table [id=2791dea288134a7ca6b9590e26be0098]) successfully deleted
W20260807 05:02:23.414996 16690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:23.415271 16690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:23.415315 16690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:23.419265 16690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:23.419322 16690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:23.419384 16690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:02:23.424513 16690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:38781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=45557
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:23.425505 16690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:23.426460 16690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:23.435607 16713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:23.435721 16708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:23.435951 16690 server_base.cc:1034] running on GCE node
W20260807 05:02:23.435721 16704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:23.436379 16690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:23.436985 16690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:23.438139 16690 hybrid_clock.cc:648] HybridClock initialized: now 1786078943438123 us; error 27 us; skew 500 ppm
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078943, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:23.440831 16690 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:02:23.441648 16690 webserver.cc:460] Webserver started at http://127.25.214.194:45557/ using document root <none> and password file <none>
I20260807 05:02:23.442178 16690 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:23.442260 16690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:23.445958 16690 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:02:23.447841 16724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.448966 16690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:23.449081 16690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "e18745e30ce1467797b7c067f7022713"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "19b4148adc7fc35dbc266496a0dc8679"
server_key_iv: "f04dec9a44a5986d4572384b8449401c"
server_key_version: "encryptionkey@0"
I20260807 05:02:23.449600 16690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:23.463647 16690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:23.466195 16690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:23.466352 16690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:23.466883 16690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:23.467653 16690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:23.467700 16690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.467751 16690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:23.467777 16690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.476171 16690 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:38781
I20260807 05:02:23.476210 16901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:38781 every 8 connection(s)
I20260807 05:02:23.477110 16690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078943, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:23.486109 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 16690
I20260807 05:02:23.486524 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:35803
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:43641
--webserver_port=41237
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:23.489909 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.478748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:50187 (local address 127.25.214.254:43641)
0807 05:02:23.478874 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.478878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.479660 (+ 782us) server_negotiation.cc:407] Connection header received
0807 05:02:23.480971 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.480974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.481031 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.481109 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:23.482235 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.482762 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.483924 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.484191 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.484269 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.486609 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:23.486613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:23.486616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:23.486646 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:23.487895 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.488430 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.488435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.488436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.488512 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.488842 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.488846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.488847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.489024 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:23.489116 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.489600 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.489740 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:02:23.490667 16909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.479064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:50187)
0807 05:02:23.479491 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.479531 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.480777 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.481261 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.481268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.481617 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:23.482107 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.482122 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.482856 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.482858 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.483819 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.483831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.484342 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.484346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.484488 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.484989 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:23.485004 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:23.486436 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:23.488006 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.488011 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.488026 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.488335 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.488605 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.488607 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.488609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.488753 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.489128 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:23.489135 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:23.489369 (+ 234us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.489534 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.489848 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":101,"threads_started":1}
I20260807 05:02:23.491842 16904 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43641
I20260807 05:02:23.492063 16904 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:23.492571 16904 heartbeater.cc:511] Master 127.25.214.254:43641 requested a full tablet report, sending...
I20260807 05:02:23.493628 16393 ts_manager.cc:194] Registered new tserver with Master: e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781)
I20260807 05:02:23.494177 16393 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:50187
W20260807 05:02:23.599680 16911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:23.599967 16911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:23.600029 16911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:23.604136 16911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:23.604212 16911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:23.604290 16911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:02:23.609855 16911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:35803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=41237
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:23.610860 16911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:23.611858 16911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:23.621140 16919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:23.621176 16922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:23.621266 16911 server_base.cc:1034] running on GCE node
W20260807 05:02:23.621167 16916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:23.621810 16911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:23.622412 16911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:23.623570 16911 hybrid_clock.cc:648] HybridClock initialized: now 1786078943623550 us; error 39 us; skew 500 ppm
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078943, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:23.626082 16911 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:02:23.626869 16911 webserver.cc:460] Webserver started at http://127.25.214.195:41237/ using document root <none> and password file <none>
I20260807 05:02:23.627388 16911 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:23.627468 16911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:23.631091 16911 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:23.633016 16931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.634140 16911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:23.634258 16911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "08768d4128944ca9826000c79a49edf8"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "7732d936e0a60478d5fa54b92dc39ee7"
server_key_iv: "d5e07109c65687d98984dd6068be1635"
server_key_version: "encryptionkey@0"
I20260807 05:02:23.634768 16911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:23.648443 16911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:23.651180 16911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:23.651355 16911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:23.651928 16911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:23.652845 16911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:23.652895 16911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.652948 16911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:23.652976 16911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:23.661504 16911 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:35803
I20260807 05:02:23.661532 17108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:35803 every 8 connection(s)
I20260807 05:02:23.662501 16911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:02:23.663491 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 16911
I20260807 05:02:23.672251 17112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.664267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37826 (local address 127.25.214.254:43641)
0807 05:02:23.664510 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.664513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.664736 (+ 223us) server_negotiation.cc:407] Connection header received
0807 05:02:23.664895 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.664897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.664940 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.665011 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:23.665936 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.666486 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.667324 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.667558 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.667650 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.669280 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:23.669285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:23.669287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:23.669315 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:23.670625 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.671010 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.671013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.671015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.671113 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.671366 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.671370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.671372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.671554 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:23.671761 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.671910 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.672046 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":198,"thread_start_us":68,"threads_started":1}
Aug 07 05:02:23 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078943, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:23.676210 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.664267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:50605 (local address 127.25.214.254:43641)
0807 05:02:23.664381 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.664386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.665510 (+ 1124us) server_negotiation.cc:407] Connection header received
0807 05:02:23.666828 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.666831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.666886 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.666956 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:23.668198 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.668923 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.670326 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.670544 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.670646 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.673213 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:23.673218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:23.673220 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:23.673244 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:23.674544 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.674978 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.674980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.674981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.675045 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:23.675309 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:23.675311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:23.675312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:23.675459 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:23.675524 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.675950 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.676040 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 05:02:23.677093 17114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.664874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:50605)
0807 05:02:23.665373 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.665414 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.666634 (+ 1220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.667144 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.667151 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.667499 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:23.668015 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.668038 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.669082 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.669085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.670208 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.670220 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.670707 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.670711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.670872 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.671357 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:23.671373 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:23.672951 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:23.674645 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.674650 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.674662 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.674904 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.675125 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:23.675127 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:23.675128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:23.675248 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:23.675525 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:23.675530 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:23.675766 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.675918 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.676216 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":146,"threads_started":1}
I20260807 05:02:23.678151 17109 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43641
I20260807 05:02:23.678390 17109 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:23.678889 17109 heartbeater.cc:511] Master 127.25.214.254:43641 requested a full tablet report, sending...
I20260807 05:02:23.679862 16393 ts_manager.cc:194] Registered new tserver with Master: 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
I20260807 05:02:23.680506 16393 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:50605
I20260807 05:02:23.685899 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:02:23.689940 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.686555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37838 (local address 127.25.214.254:43641)
0807 05:02:23.686699 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.686709 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.686843 (+ 134us) server_negotiation.cc:407] Connection header received
0807 05:02:23.686987 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.686989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.687083 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.687164 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:02:23.687376 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.687861 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.688743 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.688958 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.689028 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.689285 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:02:23.689651 (+ 366us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:02:23.689732 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.689781 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.689823 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 05:02:23.690577 16393 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:37838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:02:23.693814 16393 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:02:23.701771 16586 tablet_service.cc:1467] Processing CreateTablet for tablet dc6c6c2f5fb84badbb023aa34f7c64a8 (DEFAULT_TABLE table=test-table [id=f2609b31b6c64504beaf04a866e3137c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:23.702486 16586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6c6c2f5fb84badbb023aa34f7c64a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:23.705335 16519 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap starting.
I20260807 05:02:23.706244 16519 tablet_bootstrap.cc:654] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:23.706260 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.700544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:38781 (local address 127.0.0.1:34680)
0807 05:02:23.700664 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.700678 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.700756 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.701942 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.701945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.701964 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:23.702067 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.702074 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.703673 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.703676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.704667 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.704678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.705810 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.705813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.705905 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.705947 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.706026 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.706124 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":20}
I20260807 05:02:23.706293 17120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.700742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34680 (local address 127.25.214.194:38781)
0807 05:02:23.701455 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.701467 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.701491 (+ 24us) server_negotiation.cc:407] Connection header received
0807 05:02:23.701569 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.701575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.701786 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.701964 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:23.702492 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.703540 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.704803 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.705699 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.705811 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.705959 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.706067 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.706158 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":146,"threads_started":1}
I20260807 05:02:23.707053 17121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.700795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:35803 (local address 127.0.0.1:48646)
0807 05:02:23.702124 (+ 1329us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.702137 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.702232 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.702879 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.702882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.702901 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:23.702998 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.703004 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.704039 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.704042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.705178 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.705189 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.706683 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.706687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.706777 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.706802 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.706864 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.706927 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1266,"mutex_wait_us":51,"thread_start_us":89,"threads_started":1}
I20260807 05:02:23.707705 17122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.701082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48646 (local address 127.25.214.195:35803)
0807 05:02:23.701396 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.701405 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.702233 (+ 828us) server_negotiation.cc:407] Connection header received
0807 05:02:23.702459 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.702464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.702655 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.702893 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:23.703088 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.703891 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.705314 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.706190 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.707271 (+ 1081us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.707423 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.707473 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.707561 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":91,"threads_started":1}
I20260807 05:02:23.707989 16519 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: No bootstrap required, opened a new log
I20260807 05:02:23.708073 16519 ts_tablet_manager.cc:1397] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:23.708510 16519 raft_consensus.cc:348] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.708621 16519 raft_consensus.cc:374] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:23.708654 16519 raft_consensus.cc:729] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdcc9fd35317493aaefe5e7ac4da08c2, State: Initialized, Role: FOLLOWER
I20260807 05:02:23.708787 16519 consensus_queue.cc:260] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.709210 16519 ts_tablet_manager.cc:1428] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:02:23.709422 16796 tablet_service.cc:1467] Processing CreateTablet for tablet dc6c6c2f5fb84badbb023aa34f7c64a8 (DEFAULT_TABLE table=test-table [id=f2609b31b6c64504beaf04a866e3137c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:23.710673 16796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6c6c2f5fb84badbb023aa34f7c64a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:23.711843 17008 tablet_service.cc:1467] Processing CreateTablet for tablet dc6c6c2f5fb84badbb023aa34f7c64a8 (DEFAULT_TABLE table=test-table [id=f2609b31b6c64504beaf04a866e3137c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:23.712991 17008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6c6c2f5fb84badbb023aa34f7c64a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:23.719439 17124 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Bootstrap starting.
I20260807 05:02:23.721155 17126 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Bootstrap starting.
I20260807 05:02:23.722503 17124 tablet_bootstrap.cc:654] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:23.723291 17124 log.cc:824] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:23.723500 17126 tablet_bootstrap.cc:654] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:23.724210 17126 log.cc:824] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:23.725241 17124 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: No bootstrap required, opened a new log
I20260807 05:02:23.725437 17124 ts_tablet_manager.cc:1397] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:02:23.725909 17126 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: No bootstrap required, opened a new log
I20260807 05:02:23.726071 17126 ts_tablet_manager.cc:1397] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 05:02:23.728711 17124 raft_consensus.cc:348] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.728937 17124 raft_consensus.cc:374] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:23.729002 17124 raft_consensus.cc:729] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e18745e30ce1467797b7c067f7022713, State: Initialized, Role: FOLLOWER
I20260807 05:02:23.729039 17126 raft_consensus.cc:348] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.729280 17126 raft_consensus.cc:374] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:23.729339 17126 raft_consensus.cc:729] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08768d4128944ca9826000c79a49edf8, State: Initialized, Role: FOLLOWER
I20260807 05:02:23.729452 17124 consensus_queue.cc:260] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.729723 17126 consensus_queue.cc:260] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.730115 16904 heartbeater.cc:503] Master 127.25.214.254:43641 was elected leader, sending a full tablet report...
I20260807 05:02:23.730301 17109 heartbeater.cc:503] Master 127.25.214.254:43641 was elected leader, sending a full tablet report...
I20260807 05:02:23.730445 17124 ts_tablet_manager.cc:1428] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 05:02:23.730630 17126 ts_tablet_manager.cc:1428] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:02:23.761190 17132 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:23.761408 17132 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.762569 17132 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917)
I20260807 05:02:23.766414 17114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.762819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:32917 (local address 127.25.214.195:59641)
0807 05:02:23.762936 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.762951 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.763045 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.763380 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.763382 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.763402 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:23.763525 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.763542 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.764443 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.764447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.765253 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.765263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.766000 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.766004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.766111 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.766132 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.766207 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.766277 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 05:02:23.766425 17120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.762941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:56393 (local address 127.25.214.194:38781)
0807 05:02:23.763071 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.763076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.763470 (+ 394us) server_negotiation.cc:407] Connection header received
0807 05:02:23.763563 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.763566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.763618 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.763679 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:23.763935 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.764473 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.765467 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.765855 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.765953 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.766009 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.766236 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.766302 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:02:23.766426 16695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.762935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:59641 (local address 127.25.214.193:32917)
0807 05:02:23.763061 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.763066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.763113 (+ 47us) server_negotiation.cc:407] Connection header received
0807 05:02:23.763170 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.763173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.763247 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.763347 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:23.763649 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.764341 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.765388 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.765864 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.765975 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.766131 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.766221 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.766297 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 05:02:23.766812 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.762819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:38781 (local address 127.25.214.195:56393)
0807 05:02:23.763370 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.763385 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:23.763484 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:23.763705 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:23.763707 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:23.763724 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:23.763837 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.763844 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.764587 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.764590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.765345 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:23.765357 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.765975 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.765979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:23.766085 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.766109 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:02:23.766608 (+ 499us) client_negotiation.cc:240] Negotiation successful
0807 05:02:23.766681 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":140,"thread_start_us":162,"threads_started":1}
I20260807 05:02:23.767083 16614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6c6c2f5fb84badbb023aa34f7c64a8" candidate_uuid: "08768d4128944ca9826000c79a49edf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" is_pre_election: true
I20260807 05:02:23.767397 16614 raft_consensus.cc:2454] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08768d4128944ca9826000c79a49edf8 in term 0.
I20260807 05:02:23.767468 16829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6c6c2f5fb84badbb023aa34f7c64a8" candidate_uuid: "08768d4128944ca9826000c79a49edf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e18745e30ce1467797b7c067f7022713" is_pre_election: true
I20260807 05:02:23.767742 16829 raft_consensus.cc:2454] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08768d4128944ca9826000c79a49edf8 in term 0.
I20260807 05:02:23.767879 16939 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08768d4128944ca9826000c79a49edf8, fdcc9fd35317493aaefe5e7ac4da08c2; no voters:
I20260807 05:02:23.768200 17132 raft_consensus.cc:2781] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:02:23.768316 17132 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:02:23.768373 17132 raft_consensus.cc:3037] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:23.769413 17132 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.769753 17132 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [CANDIDATE]: Term 1 election: Requested vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917)
I20260807 05:02:23.770080 16829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6c6c2f5fb84badbb023aa34f7c64a8" candidate_uuid: "08768d4128944ca9826000c79a49edf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e18745e30ce1467797b7c067f7022713"
I20260807 05:02:23.770108 16614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6c6c2f5fb84badbb023aa34f7c64a8" candidate_uuid: "08768d4128944ca9826000c79a49edf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
I20260807 05:02:23.770212 16614 raft_consensus.cc:3037] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:23.770212 16829 raft_consensus.cc:3037] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:23.771438 16614 raft_consensus.cc:2454] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08768d4128944ca9826000c79a49edf8 in term 1.
I20260807 05:02:23.771438 16829 raft_consensus.cc:2454] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08768d4128944ca9826000c79a49edf8 in term 1.
I20260807 05:02:23.771708 16939 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08768d4128944ca9826000c79a49edf8, fdcc9fd35317493aaefe5e7ac4da08c2; no voters:
I20260807 05:02:23.771867 17132 raft_consensus.cc:2781] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:23.772122 17132 raft_consensus.cc:686] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 1 LEADER]: Becoming Leader. State: Replica: 08768d4128944ca9826000c79a49edf8, State: Running, Role: LEADER
I20260807 05:02:23.772454 17132 consensus_queue.cc:237] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:23.775686 16393 catalog_manager.cc:5495] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08768d4128944ca9826000c79a49edf8 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "08768d4128944ca9826000c79a49edf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
W20260807 05:02:23.788498 16683 tablet.cc:2369] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:02:23.791049 17122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.787499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48656 (local address 127.25.214.195:35803)
0807 05:02:23.787639 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:23.787644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:23.787658 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:02:23.787740 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:23.787743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:23.787797 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:23.787890 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:02:23.788163 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.788704 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.789561 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:23.789772 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:23.789863 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:23.790181 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:02:23.790637 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:02:23.790745 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:23.790819 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 05:02:23.790881 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 05:02:23.797116 16614 raft_consensus.cc:1261] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Refusing update from remote peer 08768d4128944ca9826000c79a49edf8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:23.797123 16829 raft_consensus.cc:1261] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Refusing update from remote peer 08768d4128944ca9826000c79a49edf8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:23.797780 17137 consensus_queue.cc:1035] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:23.797955 17132 consensus_queue.cc:1035] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:23.803164 17144 mvcc.cc:205] Tried to move back new op lower bound from 7315779353785647104 to 7315779353694556160. Current Snapshot: MvccSnapshot[applied={T|T < 7315779353785647104}]
I20260807 05:02:23.803817 17145 mvcc.cc:205] Tried to move back new op lower bound from 7315779353785647104 to 7315779353694556160. Current Snapshot: MvccSnapshot[applied={T|T < 7315779353785647104}]
I20260807 05:02:23.813323 16393 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:37838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:23.813510 16393 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:37838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:23.815929 16393 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Sending DeleteTablet for 3 replicas of tablet dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:23.816658 16586 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6c6c2f5fb84badbb023aa34f7c64a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:23 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:39164
I20260807 05:02:23.816673 17008 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6c6c2f5fb84badbb023aa34f7c64a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:23 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:48646
I20260807 05:02:23.816655 16796 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6c6c2f5fb84badbb023aa34f7c64a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:23 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:34680
I20260807 05:02:23.816851 16697 tablet_replica.cc:330] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: stopping tablet replica
I20260807 05:02:23.816965 16697 raft_consensus.cc:2229] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:23.817127 16697 raft_consensus.cc:2258] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:23.817260 17165 tablet_replica.cc:330] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: stopping tablet replica
I20260807 05:02:23.817556 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 16453
I20260807 05:02:23.817603 17165 raft_consensus.cc:2229] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:23.818291 17165 raft_consensus.cc:2258] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:23.825721 17165 ts_tablet_manager.cc:1905] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:23.827267 17166 tablet_replica.cc:330] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: stopping tablet replica
I20260807 05:02:23.827589 17166 raft_consensus.cc:2229] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:02:23.827942 17166 raft_consensus.cc:2258] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:23.830242 17165 ts_tablet_manager.cc:1918] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:23.830358 17165 log.cc:1196] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:23.830706 17165 ts_tablet_manager.cc:1939] T dc6c6c2f5fb84badbb023aa34f7c64a8 P e18745e30ce1467797b7c067f7022713: Deleting consensus metadata
I20260807 05:02:23.832916 17166 ts_tablet_manager.cc:1905] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:23.835217 17166 ts_tablet_manager.cc:1918] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:23.835319 17166 log.cc:1196] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:23.835626 17166 ts_tablet_manager.cc:1939] T dc6c6c2f5fb84badbb023aa34f7c64a8 P 08768d4128944ca9826000c79a49edf8: Deleting consensus metadata
I20260807 05:02:23.836864 16367 catalog_manager.cc:4841] TS 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): tablet dc6c6c2f5fb84badbb023aa34f7c64a8 (table test-table [id=f2609b31b6c64504beaf04a866e3137c]) successfully deleted
I20260807 05:02:23.856215 16365 catalog_manager.cc:4841] TS e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): tablet dc6c6c2f5fb84badbb023aa34f7c64a8 (table test-table [id=f2609b31b6c64504beaf04a866e3137c]) successfully deleted
W20260807 05:02:23.869668 16367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:32917 (error 108)
I20260807 05:02:23.870347 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 16690
I20260807 05:02:23.875412 17121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:23.870527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:32917 (local address 127.0.0.1:39168)
0807 05:02:23.875211 (+ 4684us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:23.875308 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:32917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4562}
W20260807 05:02:23.878441 16367 catalog_manager.cc:4584] TS fdcc9fd35317493aaefe5e7ac4da08c2 (127.25.214.193:32917): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dc6c6c2f5fb84badbb023aa34f7c64a8: Network error: Client connection negotiation failed: client connection to 127.25.214.193:32917: connect: Connection refused (error 111)
I20260807 05:02:23.884004 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 16911
I20260807 05:02:23.896701 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 16335
I20260807 05:02:23.912247 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43641
--webserver_interface=127.25.214.254
--webserver_port=43763
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:24.027796 17169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:24.028066 17169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:24.028146 17169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:24.032056 17169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:24.032145 17169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:24.032162 17169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:24.032178 17169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:24.032191 17169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:24.037503 17169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=43763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:24.038684 17169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:24.039812 17169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:24.048554 17183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:24.048558 17179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.048683 17169 server_base.cc:1034] running on GCE node
W20260807 05:02:24.048558 17177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.049453 17169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:24.050591 17169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:24.051776 17169 hybrid_clock.cc:648] HybridClock initialized: now 1786078944051752 us; error 40 us; skew 500 ppm
Aug 07 05:02:24 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078944, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:24.054571 17169 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:24.055531 17169 webserver.cc:460] Webserver started at http://127.25.214.254:43763/ using document root <none> and password file <none>
I20260807 05:02:24.056139 17169 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:24.056213 17169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:24.060422 17169 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:02:24.062619 17195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.063869 17169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:24.063987 17169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "45335e7e50a44327ac2e5b0799767e63"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "56e737e7695e5da9b1506ae64419c3da"
server_key_iv: "739aebfe8554e7ccf288d91d6012d934"
server_key_version: "encryptionkey@0"
I20260807 05:02:24.064604 17169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:24.075780 17169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:24.078706 17169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:24.078881 17169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:24.085928 17169 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43641
I20260807 05:02:24.086192 17276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43641 every 8 connection(s)
I20260807 05:02:24.087100 17169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:24.088554 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 17169
I20260807 05:02:24.088975 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:32917
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:43641
--webserver_port=41389
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:24.092013 17277 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:02:24.093880 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap starting.
I20260807 05:02:24.111245 17277 log.cc:824] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:24.122469 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:02:24.122859 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63: Bootstrap complete.
I20260807 05:02:24.126937 17277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:24.127336 17277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45335e7e50a44327ac2e5b0799767e63, State: Initialized, Role: FOLLOWER
I20260807 05:02:24.127801 17277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:24.127918 17277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:24.127980 17277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:24.128103 17277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 05:02:24.129988 17277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:24.130314 17277 leader_election.cc:302] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45335e7e50a44327ac2e5b0799767e63; no voters:
I20260807 05:02:24.130609 17277 leader_election.cc:288] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 05:02:24.130710 17283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 05:02:24.130927 17283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [term 3 LEADER]: Becoming Leader. State: Replica: 45335e7e50a44327ac2e5b0799767e63, State: Running, Role: LEADER
I20260807 05:02:24.131219 17283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } }
I20260807 05:02:24.131872 17277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:24.132211 17283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45335e7e50a44327ac2e5b0799767e63. Latest consensus state: current_term: 3 leader_uuid: "45335e7e50a44327ac2e5b0799767e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } } }
I20260807 05:02:24.132439 17283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:24.133654 17291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:24.133826 17285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "45335e7e50a44327ac2e5b0799767e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45335e7e50a44327ac2e5b0799767e63" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43641 } } }
I20260807 05:02:24.134069 17285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45335e7e50a44327ac2e5b0799767e63 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:24.138001 17291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:24.138514 17291 catalog_manager.cc:1259] Loaded cluster ID: 1da68071d7b24b7085979c79dfdfb1ae
I20260807 05:02:24.138579 17291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 05:02:24.139472 17291 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2578bfd9ad google::LogMessage::Fail() at ??:0
@ 0x7f2578c0088a google::LogMessage::SendToLog() at ??:0
@ 0x7f2578bfd4de google::LogMessage::Flush() at ??:0
@ 0x7f2578bfea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f258353cfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f258353dd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f258353a579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f258357e640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f257ae4f3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f257ae4fc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f257ae513f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f257ae40512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f257c4846db start_thread at ??:0
@ 0x7f25776fb61f clone at ??:0
W20260807 05:02:24.218107 17279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:24.218355 17279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:24.218416 17279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:24.222383 17279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:24.222440 17279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:24.222515 17279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:02:24.227706 17279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:32917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=41389
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:24.228785 17279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:24.229800 17279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:24.239287 17342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:24.239319 17337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.239450 17279 server_base.cc:1034] running on GCE node
W20260807 05:02:24.239590 17339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.239984 17279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:24.240630 17279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:24.241802 17279 hybrid_clock.cc:648] HybridClock initialized: now 1786078944241781 us; error 51 us; skew 500 ppm
Aug 07 05:02:24 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078944, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:24.244642 17279 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:02:24.245740 17279 webserver.cc:460] Webserver started at http://127.25.214.193:41389/ using document root <none> and password file <none>
I20260807 05:02:24.246448 17279 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:24.246542 17279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:24.251367 17279 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 05:02:24.253952 17353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.255349 17279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:24.255467 17279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "fdcc9fd35317493aaefe5e7ac4da08c2"
format_stamp: "Formatted at 2026-08-07 05:02:21 on dist-test-slave-lgr5"
server_key: "894f071dee4abbaa2d4f29aeaa7b06ff"
server_key_iv: "ba40adfe8c96c2dc7b9547b57367877c"
server_key_version: "encryptionkey@0"
I20260807 05:02:24.256160 17279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:24.292516 17279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:24.296058 17279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:24.296284 17279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:24.297068 17279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:24.298444 17367 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 05:02:24.302706 17279 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 05:02:24.302791 17279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260807 05:02:24.302872 17279 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 05:02:24.305173 17279 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 05:02:24.305238 17279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 05:02:24.305514 17367 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap starting.
I20260807 05:02:24.316634 17279 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:32917
I20260807 05:02:24.317118 17530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:32917 every 8 connection(s)
I20260807 05:02:24.318002 17279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:02:24.325654 17367 log.cc:824] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:24.327028 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 17279
I20260807 05:02:24.327508 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:38781
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:43641
--webserver_port=45557
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:24.333257 17367 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:02:24.333647 17367 tablet_bootstrap.cc:492] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Bootstrap complete.
I20260807 05:02:24.335177 17367 ts_tablet_manager.cc:1397] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent bootstrapping tablet: real 0.030s user 0.027s sys 0.000s
I20260807 05:02:24.338459 17367 raft_consensus.cc:348] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:24.339010 17367 raft_consensus.cc:729] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdcc9fd35317493aaefe5e7ac4da08c2, State: Initialized, Role: FOLLOWER
I20260807 05:02:24.339555 17367 consensus_queue.cc:260] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:24.340691 17367 ts_tablet_manager.cc:1428] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
W20260807 05:02:24.416440 17536 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:02:24.320597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:40167)
0807 05:02:24.321248 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.321310 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:24.322399 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:24.415562 (+ 93163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":158,"threads_started":1}
W20260807 05:02:24.417049 17532 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:43641 (0 consecutive failures): Network error: Failed to ping master at 127.25.214.254:43641: Client connection negotiation failed: client connection to 127.25.214.254:43641: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 05:02:24.417872 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.417585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:59625)
0807 05:02:24.417727 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.417804 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 05:02:24.418591 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.418372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:39239)
0807 05:02:24.418480 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.418532 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 05:02:24.418774 17532 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:02:24.446241 17538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:24.446482 17538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:24.446533 17538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:24.450474 17538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:24.450529 17538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:24.450591 17538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:02:24.455746 17538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:38781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=45557
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:24.456851 17538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:24.457891 17538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:24.467722 17546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.467821 17538 server_base.cc:1034] running on GCE node
W20260807 05:02:24.467730 17556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:24.467730 17550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.468417 17538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:24.469049 17538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:24.470206 17538 hybrid_clock.cc:648] HybridClock initialized: now 1786078944470188 us; error 30 us; skew 500 ppm
Aug 07 05:02:24 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078944, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:24.472859 17538 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:02:24.473711 17538 webserver.cc:460] Webserver started at http://127.25.214.194:45557/ using document root <none> and password file <none>
I20260807 05:02:24.474234 17538 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:24.474293 17538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:24.477978 17538 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.002s
I20260807 05:02:24.479981 17568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.481159 17538 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:24.481269 17538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "e18745e30ce1467797b7c067f7022713"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "19b4148adc7fc35dbc266496a0dc8679"
server_key_iv: "f04dec9a44a5986d4572384b8449401c"
server_key_version: "encryptionkey@0"
I20260807 05:02:24.481813 17538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:24.504580 17538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:24.507566 17538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:24.507736 17538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:24.508337 17538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:24.509140 17538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:24.509184 17538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.509227 17538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:24.509260 17538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.517638 17538 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:38781
I20260807 05:02:24.517670 17745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:38781 every 8 connection(s)
I20260807 05:02:24.518574 17538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:02:24.519145 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 17538
I20260807 05:02:24.519634 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:35803
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:43641
--webserver_port=41237
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:02:24.522328 17749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.520731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:36463)
0807 05:02:24.521227 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.521669 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":98,"threads_started":1}
W20260807 05:02:24.522740 17746 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:43641 (0 consecutive failures): Network error: Failed to ping master at 127.25.214.254:43641: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
I20260807 05:02:24.523311 17749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.523081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:50243)
0807 05:02:24.523197 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.523250 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 05:02:24.523928 17749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.523702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:32903)
0807 05:02:24.523818 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.523868 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 05:02:24.524125 17746 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:02:24.631523 17750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:24.631789 17750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:24.631830 17750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:24.635694 17750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:24.635748 17750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:24.635836 17750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:02:24.641088 17750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:35803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=41237
--tserver_master_addrs=127.25.214.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:24.642145 17750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:24.643127 17750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:02:24.652638 17750 server_base.cc:1034] running on GCE node
W20260807 05:02:24.652588 17760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:24.652624 17759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:24.652588 17762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:24.653240 17750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:24.653882 17750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:24.655035 17750 hybrid_clock.cc:648] HybridClock initialized: now 1786078944655019 us; error 31 us; skew 500 ppm
Aug 07 05:02:24 dist-test-slave-lgr5 krb5kdc[15454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078944, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:24.657709 17750 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:02:24.658529 17750 webserver.cc:460] Webserver started at http://127.25.214.195:41237/ using document root <none> and password file <none>
I20260807 05:02:24.659063 17750 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:24.659122 17750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:24.663091 17750 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:02:24.665141 17775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.666298 17750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:02:24.666397 17750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "08768d4128944ca9826000c79a49edf8"
format_stamp: "Formatted at 2026-08-07 05:02:22 on dist-test-slave-lgr5"
server_key: "7732d936e0a60478d5fa54b92dc39ee7"
server_key_iv: "d5e07109c65687d98984dd6068be1635"
server_key_version: "encryptionkey@0"
I20260807 05:02:24.666947 17750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:24.697727 17750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:24.700692 17750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:24.700862 17750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:24.701429 17750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:24.702293 17750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:24.702342 17750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.702382 17750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:24.702402 17750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:24.711061 17750 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:35803
I20260807 05:02:24.711100 17963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:35803 every 8 connection(s)
I20260807 05:02:24.712119 17750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:02:24.715945 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.714327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:33777)
0807 05:02:24.714793 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.715230 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":127,"threads_started":1}
W20260807 05:02:24.716392 17964 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:43641 (0 consecutive failures): Network error: Failed to ping master at 127.25.214.254:43641: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
I20260807 05:02:24.716890 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 17750
I20260807 05:02:24.717053 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.716789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:44745)
0807 05:02:24.716919 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.716978 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 05:02:24.717696 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:24.717486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:39071)
0807 05:02:24.717596 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:24.717644 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 05:02:24.717868 17964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 05:02:25.419854 17970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.419405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:57047)
0807 05:02:25.419672 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:25.419735 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
I20260807 05:02:25.525022 17971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.524635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:59095)
0807 05:02:25.524870 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:25.524925 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":75,"threads_started":1}
I20260807 05:02:25.718830 17972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.718437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:40191)
0807 05:02:25.718664 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:25.718722 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":76,"threads_started":1}
I20260807 05:02:25.927858 17973 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:25.928098 17973 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:25.929278 17973 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
Aug 07 05:02:25 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078944, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.194@KRBTEST.COM
Aug 07 05:02:25 dist-test-slave-lgr5 krb5kdc[15454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078944, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.195@KRBTEST.COM
I20260807 05:02:25.942924 17976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.929569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:35803 (local address 127.25.214.193:38339)
0807 05:02:25.929883 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:25.929897 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:25.930006 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:25.931621 (+ 1615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:25.931627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:25.932243 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:25.932736 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:25.932752 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.934044 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.934048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:25.935054 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:25.935078 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.935771 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.935775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:25.936000 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:25.937011 (+ 1011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:25.937026 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:25.938466 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:25.940545 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:25.940549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:25.940551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:25.940761 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:25.941100 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:25.941103 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:25.941104 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:25.941212 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:25.941866 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:25.941872 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:25.942133 (+ 261us) client_negotiation.cc:769] Sending connection context
0807 05:02:25.942315 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 05:02:25.942735 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":185,"spinlock_wait_cycles":27136,"thread_start_us":72,"threads_started":1}
I20260807 05:02:25.942939 17977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.929688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:57145 (local address 127.25.214.194:38781)
0807 05:02:25.930178 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:25.930199 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:25.930232 (+ 33us) server_negotiation.cc:407] Connection header received
0807 05:02:25.930869 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:25.930875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:25.931235 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:25.931516 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:25.932916 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.933905 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.935183 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.935652 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.935802 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:25.938446 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:25.938454 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:25.938472 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:25.938508 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:25.940186 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:25.940817 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:25.940824 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:25.940830 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:25.940962 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:25.941307 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:25.941310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:25.941312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:25.941746 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:25.941873 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:25.942455 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 05:02:25.942741 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":58,"threads_started":1}
I20260807 05:02:25.942943 17978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.929729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:38339 (local address 127.25.214.195:35803)
0807 05:02:25.930129 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:25.930153 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:25.930189 (+ 36us) server_negotiation.cc:407] Connection header received
0807 05:02:25.930869 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:25.930876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:25.931235 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:25.931516 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:25.932910 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.933897 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.935183 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.935649 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.935810 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:25.938659 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:25.938664 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:25.938676 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:25.938705 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:25.940429 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:25.940876 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:25.940881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:25.940885 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:25.941001 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:25.941314 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:25.941317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:25.941318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:25.941745 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:25.941873 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:25.942451 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 05:02:25.942741 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":95,"threads_started":1}
I20260807 05:02:25.942970 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:25.929549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:38781 (local address 127.25.214.193:57145)
0807 05:02:25.929864 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:25.929880 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:25.929992 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:25.931621 (+ 1629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:25.931627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:25.932244 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:25.932736 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:25.932751 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.934045 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.934048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:25.935055 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:25.935078 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:25.935771 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:25.935775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:25.935999 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:25.936667 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:25.936685 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:25.938178 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:25.940308 (+ 2130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:25.940314 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:25.940331 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:25.940702 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:25.941056 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:25.941060 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:25.941062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:25.941213 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:25.941867 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:25.941873 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:25.942134 (+ 261us) client_negotiation.cc:769] Sending connection context
0807 05:02:25.942315 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 05:02:25.942811 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":360,"spinlock_wait_cycles":7296,"thread_start_us":77,"threads_started":1}
W20260807 05:02:25.945915 17358 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
W20260807 05:02:25.946205 17361 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:25.946270 17361 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdcc9fd35317493aaefe5e7ac4da08c2; no voters: 08768d4128944ca9826000c79a49edf8, e18745e30ce1467797b7c067f7022713
I20260807 05:02:25.946573 17973 raft_consensus.cc:2726] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:02:26.421072 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:26.420762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:51445)
0807 05:02:26.420916 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:26.420982 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 05:02:26.526234 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:26.525792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:52313)
0807 05:02:26.526070 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:26.526131 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":91,"threads_started":1}
I20260807 05:02:26.719902 17981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:26.719516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:36549)
0807 05:02:26.719752 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:26.719807 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":73,"threads_started":1}
I20260807 05:02:27.422475 17982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:27.421978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:60077)
0807 05:02:27.422273 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:27.422349 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":85,"threads_started":1}
I20260807 05:02:27.504102 17983 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:27.504257 17983 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:27.504683 17983 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
W20260807 05:02:27.505478 17358 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
W20260807 05:02:27.505590 17361 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:27.505681 17361 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdcc9fd35317493aaefe5e7ac4da08c2; no voters: 08768d4128944ca9826000c79a49edf8, e18745e30ce1467797b7c067f7022713
I20260807 05:02:27.505820 17983 raft_consensus.cc:2726] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:02:27.527406 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:27.526966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:59099)
0807 05:02:27.527241 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:27.527300 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":83,"threads_started":1}
I20260807 05:02:27.720988 17989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:27.720577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:54037)
0807 05:02:27.720824 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:27.720878 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":75,"threads_started":1}
I20260807 05:02:28.423810 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:28.423364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:36925)
0807 05:02:28.423652 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:28.423709 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":83,"threads_started":1}
I20260807 05:02:28.528573 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:28.528188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:54967)
0807 05:02:28.528418 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:28.528474 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":72,"threads_started":1}
I20260807 05:02:28.722123 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:28.721699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:39621)
0807 05:02:28.721971 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:28.722028 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":89,"threads_started":1}
I20260807 05:02:29.087234 17996 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:29.087378 17996 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:29.087812 17996 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
W20260807 05:02:29.088661 17358 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
W20260807 05:02:29.088792 17361 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:29.088858 17361 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdcc9fd35317493aaefe5e7ac4da08c2; no voters: 08768d4128944ca9826000c79a49edf8, e18745e30ce1467797b7c067f7022713
I20260807 05:02:29.088999 17996 raft_consensus.cc:2726] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:02:29.425278 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:29.424794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:55573)
0807 05:02:29.425114 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:29.425178 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":76,"threads_started":1}
I20260807 05:02:29.529764 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:29.529337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:53211)
0807 05:02:29.529605 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:29.529665 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":79,"threads_started":1}
I20260807 05:02:29.723332 18004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:29.722933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:60189)
0807 05:02:29.723174 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:29.723232 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":83,"threads_started":1}
I20260807 05:02:30.426548 18005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:30.426016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:48611)
0807 05:02:30.426370 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:30.426437 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":107,"threads_started":1}
I20260807 05:02:30.530928 18006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:30.530512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:37729)
0807 05:02:30.530771 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:30.530828 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260807 05:02:30.724375 18008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:30.723987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:36825)
0807 05:02:30.724229 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:30.724282 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":114,"threads_started":1}
I20260807 05:02:31.428021 18009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:31.427539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:50615)
0807 05:02:31.427853 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:31.427920 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":102,"threads_started":1}
I20260807 05:02:31.532410 18010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:31.531868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:57417)
0807 05:02:31.532239 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:31.532308 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":101,"threads_started":1}
I20260807 05:02:31.725737 18011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:31.725226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:46677)
0807 05:02:31.725570 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:31.725637 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":94,"threads_started":1}
I20260807 05:02:32.296844 18013 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:32.296986 18013 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:32.297413 18013 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
W20260807 05:02:32.298167 17358 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
W20260807 05:02:32.298278 17361 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:32.298337 17361 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdcc9fd35317493aaefe5e7ac4da08c2; no voters: 08768d4128944ca9826000c79a49edf8, e18745e30ce1467797b7c067f7022713
I20260807 05:02:32.298465 18013 raft_consensus.cc:2726] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:02:32.429349 18014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:32.428892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:40211)
0807 05:02:32.429179 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:32.429244 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":86,"threads_started":1}
I20260807 05:02:32.533705 18016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:32.533241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:46705)
0807 05:02:32.533533 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:32.533598 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":86,"threads_started":1}
I20260807 05:02:32.726800 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:32.726412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:37065)
0807 05:02:32.726652 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:32.726705 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":73,"threads_started":1}
I20260807 05:02:33.430496 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:33.430109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:38129)
0807 05:02:33.430342 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:33.430396 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260807 05:02:33.534982 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:33.534529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:34303)
0807 05:02:33.534811 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:33.534878 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":84,"threads_started":1}
I20260807 05:02:33.728019 18021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:33.727567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:51765)
0807 05:02:33.727857 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:33.727920 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":83,"threads_started":1}
I20260807 05:02:34.431747 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:34.431308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:37581)
0807 05:02:34.431589 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:34.431646 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":91,"threads_started":1}
I20260807 05:02:34.536190 18025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:34.535765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:42813)
0807 05:02:34.536009 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:34.536066 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
I20260807 05:02:34.729161 18026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:34.728787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:56749)
0807 05:02:34.729016 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:34.729067 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260807 05:02:35.433068 18028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:35.432567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:54953)
0807 05:02:35.432889 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:35.432965 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":96,"threads_started":1}
I20260807 05:02:35.537268 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:35.536886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:39457)
0807 05:02:35.537119 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:35.537172 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":80,"threads_started":1}
I20260807 05:02:35.730451 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:35.729971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:46419)
0807 05:02:35.730275 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:35.730350 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":85,"threads_started":1}
I20260807 05:02:36.434368 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:36.433875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:42569)
0807 05:02:36.434196 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:36.434262 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":86,"threads_started":1}
I20260807 05:02:36.538447 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:36.538020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:40481)
0807 05:02:36.538283 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:36.538341 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":78,"threads_started":1}
I20260807 05:02:36.731761 18036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:36.731297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:36651)
0807 05:02:36.731590 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:36.731658 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":83,"threads_started":1}
I20260807 05:02:37.435621 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:37.435196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:40459)
0807 05:02:37.435464 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:37.435519 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":77,"threads_started":1}
I20260807 05:02:37.539768 18041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:37.539269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:43953)
0807 05:02:37.539603 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:37.539667 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":103,"threads_started":1}
I20260807 05:02:37.733000 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:37.732551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:39725)
0807 05:02:37.732818 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:37.732894 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":93,"threads_started":1}
I20260807 05:02:38.436771 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:38.436336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:51491)
0807 05:02:38.436612 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:38.436671 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":82,"threads_started":1}
I20260807 05:02:38.541050 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:38.540598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:47473)
0807 05:02:38.540889 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:38.540949 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":79,"threads_started":1}
I20260807 05:02:38.551925 18046 raft_consensus.cc:482] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:38.552057 18046 raft_consensus.cc:504] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e18745e30ce1467797b7c067f7022713" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 38781 } } peers { permanent_uuid: "08768d4128944ca9826000c79a49edf8" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 35803 } } peers { permanent_uuid: "fdcc9fd35317493aaefe5e7ac4da08c2" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 32917 } }
I20260807 05:02:38.552502 18046 leader_election.cc:288] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781), 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803)
W20260807 05:02:38.553272 17358 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e18745e30ce1467797b7c067f7022713 (127.25.214.194:38781): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
W20260807 05:02:38.553386 17361 leader_election.cc:341] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 08768d4128944ca9826000c79a49edf8 (127.25.214.195:35803): Not found: Tablet not found: dc6c6c2f5fb84badbb023aa34f7c64a8
I20260807 05:02:38.553447 17361 leader_election.cc:302] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdcc9fd35317493aaefe5e7ac4da08c2; no voters: 08768d4128944ca9826000c79a49edf8, e18745e30ce1467797b7c067f7022713
I20260807 05:02:38.553587 18046 raft_consensus.cc:2726] T dc6c6c2f5fb84badbb023aa34f7c64a8 P fdcc9fd35317493aaefe5e7ac4da08c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:02:38.734220 18047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:38.733791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:50451)
0807 05:02:38.734047 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:38.734120 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":82,"threads_started":1}
I20260807 05:02:39.438067 18048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:39.437669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.193:41995)
0807 05:02:39.437910 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:39.437965 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260807 05:02:39.542179 18050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:39.541812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.194:57353)
0807 05:02:39.542040 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:39.542091 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":71,"threads_started":1}
I20260807 05:02:39.723927 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 17279
I20260807 05:02:39.748834 18051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:39.748389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43641 (local address 127.25.214.195:53931)
0807 05:02:39.748669 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:39.748735 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:43641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":83,"threads_started":1}
I20260807 05:02:39.753553 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 17538
I20260807 05:02:39.771519 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 17750
2026-08-07T05:02:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19499 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:02:39 dist-test-slave-lgr5 krb5kdc[18054](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:02:39 dist-test-slave-lgr5 krb5kdc[18054](info): set up 2 sockets
Aug 07 05:02:39 dist-test-slave-lgr5 krb5kdc[18054](info): commencing operation
krb5kdc: starting...
W20260807 05:02:40.925050 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:02:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:02:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:02:41.053200 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40621
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:40621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:41.169016 18076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:41.169296 18076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:41.169337 18076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:41.173418 18076 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 05:02:41.173480 18076 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 05:02:41.173493 18076 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 05:02:41.173507 18076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:02:41.173524 18076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:41.173540 18076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:41.173555 18076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:02:41.173573 18076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:02:41.178889 18076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:40621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:41.180014 18076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:41.181070 18076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:41.190135 18087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.190207 18076 server_base.cc:1034] running on GCE node
W20260807 05:02:41.190111 18086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:41.190111 18096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.191025 18076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:41.192346 18076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:41.193522 18076 hybrid_clock.cc:648] HybridClock initialized: now 1786078961193509 us; error 31 us; skew 500 ppm
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:41.196439 18076 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:02:41.197439 18076 webserver.cc:460] Webserver started at http://127.25.214.254:46833/ using document root <none> and password file <none>
I20260807 05:02:41.198052 18076 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:41.198128 18076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:41.198381 18076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:41.200682 18076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "c67a64b56224415d978e9cc266708e29"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "de0ef9505deac4465f0a98307b52be87"
server_key_iv: "5d9998e75de976bc6ce058627ef82f0c"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.201261 18076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "c67a64b56224415d978e9cc266708e29"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "de0ef9505deac4465f0a98307b52be87"
server_key_iv: "5d9998e75de976bc6ce058627ef82f0c"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.205150 18076 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 05:02:41.207645 18107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.208902 18076 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:02:41.209040 18076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "c67a64b56224415d978e9cc266708e29"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "de0ef9505deac4465f0a98307b52be87"
server_key_iv: "5d9998e75de976bc6ce058627ef82f0c"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.209142 18076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:41.233670 18076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:41.236722 18076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:41.236909 18076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:41.244166 18076 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:40621
I20260807 05:02:41.244515 18182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:40621 every 8 connection(s)
I20260807 05:02:41.245198 18076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:02:41.248019 18183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:41.251426 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 18076
I20260807 05:02:41.251546 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:02:41.251811 26459 external_mini_cluster.cc:1428] Setting key f424d37a77c0ee6c7520b21a517894ad
I20260807 05:02:41.254081 18183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap starting.
I20260807 05:02:41.257143 18183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:41.258126 18183 log.cc:824] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:41.260882 18183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: No bootstrap required, opened a new log
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:41.264408 18183 raft_consensus.cc:348] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:02:41.264670 18183 raft_consensus.cc:374] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:41.264743 18183 raft_consensus.cc:729] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c67a64b56224415d978e9cc266708e29, State: Initialized, Role: FOLLOWER
I20260807 05:02:41.265224 18183 consensus_queue.cc:260] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:02:41.265406 18183 raft_consensus.cc:388] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:02:41.265478 18183 raft_consensus.cc:482] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:02:41.265585 18183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:41.266676 18183 raft_consensus.cc:504] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:02:41.267078 18183 leader_election.cc:302] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c67a64b56224415d978e9cc266708e29; no voters:
I20260807 05:02:41.267470 18183 leader_election.cc:288] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:02:41.267583 18190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:41.267825 18190 raft_consensus.cc:686] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 LEADER]: Becoming Leader. State: Replica: c67a64b56224415d978e9cc266708e29, State: Running, Role: LEADER
I20260807 05:02:41.268216 18190 consensus_queue.cc:237] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:02:41.268366 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.253301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56454 (local address 127.25.214.254:40621)
0807 05:02:41.253758 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:41.253777 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:41.253821 (+ 44us) server_negotiation.cc:407] Connection header received
0807 05:02:41.254648 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:41.254673 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:41.255125 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:41.255529 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:41.256287 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.257825 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.258773 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.259390 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.259539 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:41.262564 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:41.262569 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:41.262586 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:41.262619 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:41.265119 (+ 2500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:41.265677 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:41.265684 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:41.265691 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:41.265817 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:41.266104 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:41.266106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:41.266107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:41.266509 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:41.266654 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:41.267021 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 05:02:41.267331 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":128,"threads_started":1}
I20260807 05:02:41.268842 18183 sys_catalog.cc:564] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:02:41.270289 18194 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c67a64b56224415d978e9cc266708e29. Latest consensus state: current_term: 1 leader_uuid: "c67a64b56224415d978e9cc266708e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } } }
I20260807 05:02:41.270304 18193 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c67a64b56224415d978e9cc266708e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } } }
I20260807 05:02:41.270548 18193 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:41.270807 18194 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: This master's current role is: LEADER
I20260807 05:02:41.271559 18210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:02:41.274323 18210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:02:41.279939 18210 catalog_manager.cc:1347] Generated new cluster ID: f049594d61d745b49059f09a3e8b0395
I20260807 05:02:41.280023 18210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:02:41.300625 18210 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:02:41.301661 18210 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:02:41.312319 18210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Generated new TSK 0
I20260807 05:02:41.313339 18210 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:02:41.354719 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40621
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:41.477501 18224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:41.477804 18224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:41.477871 18224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:41.482244 18224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:41.482317 18224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:41.482406 18224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:02:41.487857 18224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:41.488984 18224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:41.490091 18224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:41.499492 18233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.499625 18224 server_base.cc:1034] running on GCE node
W20260807 05:02:41.499487 18230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:41.499462 18229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.500236 18224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:41.500819 18224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:41.501992 18224 hybrid_clock.cc:648] HybridClock initialized: now 1786078961501974 us; error 29 us; skew 500 ppm
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:41.504969 18224 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:02:41.505839 18224 webserver.cc:460] Webserver started at http://127.25.214.193:40325/ using document root <none> and password file <none>
I20260807 05:02:41.506395 18224 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:41.506462 18224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:41.506655 18224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:41.508772 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "9d8b780b571348ce8640e10adaa6bf21"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "a8c465e141d6a5348deb74688b6d9eed"
server_key_iv: "a888f4ff73e47ee6fbec72c21b01ce76"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.509328 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "9d8b780b571348ce8640e10adaa6bf21"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "a8c465e141d6a5348deb74688b6d9eed"
server_key_iv: "a888f4ff73e47ee6fbec72c21b01ce76"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.513135 18224 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 05:02:41.515554 18243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.516805 18224 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:41.516929 18224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "9d8b780b571348ce8640e10adaa6bf21"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "a8c465e141d6a5348deb74688b6d9eed"
server_key_iv: "a888f4ff73e47ee6fbec72c21b01ce76"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.517031 18224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:41.526814 18224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:41.529668 18224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:41.529847 18224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:41.530421 18224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:41.531250 18224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:41.531301 18224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.531352 18224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:41.531381 18224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.540020 18224 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:39629
I20260807 05:02:41.540093 18413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:39629 every 8 connection(s)
I20260807 05:02:41.540936 18224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:02:41.543200 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 18224
I20260807 05:02:41.543339 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:02:41.543706 26459 external_mini_cluster.cc:1428] Setting key 82ee4fcb6bfc8f1ea7c15e42a147b4c7
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:02:41.555006 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.542783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46835 (local address 127.25.214.254:40621)
0807 05:02:41.542946 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:41.542951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:41.544201 (+ 1250us) server_negotiation.cc:407] Connection header received
0807 05:02:41.545271 (+ 1070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:41.545275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:41.545329 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:41.545402 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:41.546678 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.547215 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.548461 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.548768 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.548869 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:41.551605 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:41.551608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:41.551610 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:41.551635 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:41.552963 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:41.553569 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:41.553572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:41.553573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:41.553647 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:41.554001 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:41.554004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:41.554007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:41.554205 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:41.554280 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:41.554759 (+ 479us) server_negotiation.cc:299] Negotiation successful
0807 05:02:41.554861 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:02:41.555837 18417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.543170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:46835)
0807 05:02:41.543979 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:41.544040 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:41.545041 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:41.545603 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:41.545610 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:41.545997 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:41.546512 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:41.546527 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.547349 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.547352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:41.548342 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:41.548353 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.548919 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.548922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:41.549092 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:41.549670 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:41.549686 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:41.551426 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:41.553096 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:41.553103 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:41.553120 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:41.553467 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:41.553731 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:41.553734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:41.553736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:41.553915 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:41.554308 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:41.554313 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:41.554560 (+ 247us) client_negotiation.cc:769] Sending connection context
0807 05:02:41.554723 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 05:02:41.555005 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":129,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
I20260807 05:02:41.557066 18414 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40621
I20260807 05:02:41.557300 18414 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:41.557780 18414 heartbeater.cc:511] Master 127.25.214.254:40621 requested a full tablet report, sending...
I20260807 05:02:41.559576 18136 ts_manager.cc:194] Registered new tserver with Master: 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193:39629)
I20260807 05:02:41.560734 18136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:46835
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:02:41.571215 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40621
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:41.689301 18422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:41.689604 18422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:41.689648 18422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:41.693773 18422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:41.693850 18422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:41.693912 18422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:02:41.699795 18422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:41.701005 18422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:41.702090 18422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:41.712638 18434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:41.712637 18430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:41.712647 18436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.713064 18422 server_base.cc:1034] running on GCE node
I20260807 05:02:41.713548 18422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:41.714242 18422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:41.715432 18422 hybrid_clock.cc:648] HybridClock initialized: now 1786078961715408 us; error 36 us; skew 500 ppm
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:41.718506 18422 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:02:41.719534 18422 webserver.cc:460] Webserver started at http://127.25.214.194:45785/ using document root <none> and password file <none>
I20260807 05:02:41.720247 18422 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:41.720347 18422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:41.720595 18422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:41.722864 18422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "502be6dc279140cf92fd8b7c0ccda003"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "15c2797bea29ff86e0c28a7ef35e7a09"
server_key_iv: "c1f2ae1e99302980715f34f0ba004561"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.723496 18422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "502be6dc279140cf92fd8b7c0ccda003"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "15c2797bea29ff86e0c28a7ef35e7a09"
server_key_iv: "c1f2ae1e99302980715f34f0ba004561"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.727555 18422 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 05:02:41.730139 18444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.731458 18422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:02:41.731606 18422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "502be6dc279140cf92fd8b7c0ccda003"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "15c2797bea29ff86e0c28a7ef35e7a09"
server_key_iv: "c1f2ae1e99302980715f34f0ba004561"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.731732 18422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:41.756939 18422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:41.760677 18422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:41.760887 18422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:41.761543 18422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:41.762465 18422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:41.762521 18422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.762583 18422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:41.762610 18422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.772450 18422 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:35083
I20260807 05:02:41.772468 18604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:35083 every 8 connection(s)
I20260807 05:02:41.773478 18422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:02:41.779182 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 18422
I20260807 05:02:41.779306 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:02:41.779614 26459 external_mini_cluster.cc:1428] Setting key 3fe85351c003d5accae8a054d9745023
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:41.787313 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.775333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:51377 (local address 127.25.214.254:40621)
0807 05:02:41.775484 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:41.775488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:41.776614 (+ 1126us) server_negotiation.cc:407] Connection header received
0807 05:02:41.777468 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:41.777470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:41.777519 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:41.777594 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:41.778750 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.779447 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.780692 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.780921 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.781011 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:41.783546 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:41.783550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:41.783553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:41.783581 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:41.784948 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:41.785544 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:41.785547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:41.785548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:41.785617 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:41.786034 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:41.786039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:41.786040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:41.786253 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:41.786336 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:41.787065 (+ 729us) server_negotiation.cc:299] Negotiation successful
0807 05:02:41.787183 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 05:02:41.788590 18608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.775715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:51377)
0807 05:02:41.776462 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:41.776508 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:41.777290 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:41.777751 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:41.777757 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:41.778141 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:41.778633 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:41.778648 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.779578 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.779581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:41.780565 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:41.780575 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:41.781063 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:41.781068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:41.781229 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:41.781796 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:41.781812 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:41.783350 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:41.785071 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:41.785077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:41.785095 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:41.785458 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:41.785708 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:41.785712 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:41.785714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:41.785914 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:41.786371 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:41.786379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:41.786776 (+ 397us) client_negotiation.cc:769] Sending connection context
0807 05:02:41.787006 (+ 230us) client_negotiation.cc:240] Negotiation successful
0807 05:02:41.787399 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":107,"threads_started":1}
I20260807 05:02:41.789816 18605 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40621
I20260807 05:02:41.790055 18605 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:02:41.790582 18605 heartbeater.cc:511] Master 127.25.214.254:40621 requested a full tablet report, sending...
I20260807 05:02:41.791635 18136 ts_manager.cc:194] Registered new tserver with Master: 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
I20260807 05:02:41.792243 18136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:51377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:02:41.809125 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40621
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:02:41.924765 18612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:02:41.925048 18612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:02:41.925097 18612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:02:41.929291 18612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:02:41.929379 18612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:02:41.929443 18612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:02:41.934929 18612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:02:41.936100 18612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:02:41.937189 18612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:02:41.946908 18620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.947131 18612 server_base.cc:1034] running on GCE node
W20260807 05:02:41.947379 18623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:02:41.947392 18621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:02:41.947909 18612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:02:41.948603 18612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:02:41.949761 18612 hybrid_clock.cc:648] HybridClock initialized: now 1786078961949742 us; error 33 us; skew 500 ppm
Aug 07 05:02:41 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:02:41.952487 18612 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:02:41.953377 18612 webserver.cc:460] Webserver started at http://127.25.214.195:34977/ using document root <none> and password file <none>
I20260807 05:02:41.953953 18612 fs_manager.cc:359] Metadata directory not provided
I20260807 05:02:41.954020 18612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:02:41.954229 18612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:02:41.956394 18612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "d7eac91a51cfd6613e0ea54bee52c44c"
server_key_iv: "2c7029dd5f42d6c76cb3dc6ecc207d6f"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.956947 18612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "d7eac91a51cfd6613e0ea54bee52c44c"
server_key_iv: "2c7029dd5f42d6c76cb3dc6ecc207d6f"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.960624 18612 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:02:41.962972 18637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.964221 18612 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:02:41.964349 18612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "d7eac91a51cfd6613e0ea54bee52c44c"
server_key_iv: "2c7029dd5f42d6c76cb3dc6ecc207d6f"
server_key_version: "encryptionkey@0"
I20260807 05:02:41.964454 18612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:02:41.980455 18612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:02:41.983562 18612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:02:41.983757 18612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:02:41.984426 18612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:02:41.985302 18612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:02:41.985353 18612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.985407 18612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:02:41.985432 18612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:02:41.994503 18612 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:39331
I20260807 05:02:41.994532 18814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:39331 every 8 connection(s)
I20260807 05:02:41.995438 18612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:02:41.996343 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 18612
I20260807 05:02:41.996454 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:02:41.996699 26459 external_mini_cluster.cc:1428] Setting key fdc0e3307be5fc4b14248f61c478ee66
Aug 07 05:02:42 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078961, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:02:42.009428 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.998149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:42315 (local address 127.25.214.254:40621)
0807 05:02:41.998277 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:41.998280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:41.999527 (+ 1247us) server_negotiation.cc:407] Connection header received
0807 05:02:42.000487 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.000490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.000545 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.000616 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:42.001784 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.002324 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.003459 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.003684 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.003769 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.006204 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:42.006207 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:42.006210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:42.006235 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:42.007393 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:42.007887 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:42.007890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:42.007892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:42.007967 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:42.008323 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:42.008326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:42.008328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:42.008508 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:42.008596 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.009126 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.009254 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 05:02:42.010349 18818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:41.998718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:42315)
0807 05:02:41.999392 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:41.999434 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:42.000297 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:42.000783 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:42.000790 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:42.001155 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:02:42.001647 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.001661 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.002445 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.002447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.003340 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.003351 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.003824 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.003828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.003989 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.004578 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:02:42.004595 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:02:42.006034 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:02:42.007504 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:42.007510 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:42.007525 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:42.007790 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:42.008052 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:02:42.008055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:02:42.008057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:02:42.008233 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:02:42.008620 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:02:42.008626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:02:42.008875 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 05:02:42.009038 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 05:02:42.009375 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":129,"threads_started":1}
I20260807 05:02:42.011399 18815 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40621
I20260807 05:02:42.011629 18815 heartbeater.cc:464] Registering TS with master...
I20260807 05:02:42.012151 18815 heartbeater.cc:511] Master 127.25.214.254:40621 requested a full tablet report, sending...
I20260807 05:02:42.013170 18136 ts_manager.cc:194] Registered new tserver with Master: e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331)
I20260807 05:02:42.013728 18136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:42315
I20260807 05:02:42.022274 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:02:42.030646 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.024245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56456 (local address 127.25.214.254:40621)
0807 05:02:42.024378 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.024383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.024603 (+ 220us) server_negotiation.cc:407] Connection header received
0807 05:02:42.024705 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.024707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.024747 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.024810 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:02:42.025408 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.025900 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.026703 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.026920 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.026995 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.028237 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:02:42.028240 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:02:42.028242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:02:42.028266 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:02:42.029364 (+ 1098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:42.029720 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:42.029722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:42.029723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:42.029793 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:02:42.029976 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:02:42.029977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:02:42.029978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:02:42.030189 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:02:42.030289 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.030432 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.030521 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:02:42.033402 18136 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:02:42.036566 18136 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:02:42.051054 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.045225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59536 (local address 127.25.214.193:39629)
0807 05:02:42.046417 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.046431 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.046455 (+ 24us) server_negotiation.cc:407] Connection header received
0807 05:02:42.046529 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.046534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.046727 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.046913 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:42.047145 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.048030 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.049741 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.050396 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.050505 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.050645 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.050805 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.050905 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1086,"thread_start_us":103,"threads_started":1}
I20260807 05:02:42.051070 18834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.045078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39629 (local address 127.0.0.1:59536)
0807 05:02:42.045533 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:42.045755 (+ 222us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:42.045902 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:42.046891 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:42.046894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:42.046912 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:42.047021 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.047028 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.048207 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.048211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.049601 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.049614 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.050505 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.050509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.050624 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.050664 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 05:02:42.050766 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 05:02:42.050886 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":1,"spinlock_wait_cycles":7296,"thread_start_us":75,"threads_started":1}
I20260807 05:02:42.051101 18832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.045158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:35083 (local address 127.0.0.1:33932)
0807 05:02:42.045746 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:42.045762 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:42.045902 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:42.046720 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:42.046726 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:42.046750 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:42.046895 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.046903 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.048475 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.048479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.049667 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.049675 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.050673 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.050677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.050769 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.050795 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 05:02:42.050848 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 05:02:42.050922 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":63,"spinlock_wait_cycles":2816,"thread_start_us":91,"threads_started":1}
I20260807 05:02:42.051512 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.045855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39331 (local address 127.0.0.1:60752)
0807 05:02:42.046857 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:42.046871 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:42.046968 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:42.047463 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:42.047466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:42.047486 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:42.047563 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.047568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.048805 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.048809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.049888 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.049899 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.051107 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.051111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.051235 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.051257 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 05:02:42.051327 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 05:02:42.051394 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"mutex_wait_us":18,"thread_start_us":97,"threads_started":1}
I20260807 05:02:42.051962 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.046261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60752 (local address 127.25.214.195:39331)
0807 05:02:42.046655 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.046666 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.047058 (+ 392us) server_negotiation.cc:407] Connection header received
0807 05:02:42.047141 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.047146 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.047316 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.047463 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:42.047674 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.048687 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.050021 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.050806 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.050911 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.051030 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.051737 (+ 707us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.051821 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":99,"threads_started":1}
I20260807 05:02:42.051960 18837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.045868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33932 (local address 127.25.214.194:35083)
0807 05:02:42.046191 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.046202 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.046225 (+ 23us) server_negotiation.cc:407] Connection header received
0807 05:02:42.046302 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.046307 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.046546 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.047041 (+ 495us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:42.047197 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.048324 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.049787 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.050511 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.051526 (+ 1015us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.051675 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.051729 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.051814 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":130,"threads_started":1}
I20260807 05:02:42.054203 18318 tablet_service.cc:1467] Processing CreateTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 (DEFAULT_TABLE table=test-table [id=683fa242022b4f55848b78d9992f6dcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:42.054216 18503 tablet_service.cc:1467] Processing CreateTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 (DEFAULT_TABLE table=test-table [id=683fa242022b4f55848b78d9992f6dcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:42.055182 18318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91c0c54a70a543c18504af94c7bbf5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:42.055181 18503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91c0c54a70a543c18504af94c7bbf5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:42.058732 18708 tablet_service.cc:1467] Processing CreateTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 (DEFAULT_TABLE table=test-table [id=683fa242022b4f55848b78d9992f6dcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:02:42.059830 18708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91c0c54a70a543c18504af94c7bbf5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:02:42.062120 18841 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Bootstrap starting.
I20260807 05:02:42.062378 18840 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap starting.
I20260807 05:02:42.064543 18840 tablet_bootstrap.cc:654] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:42.064965 18841 tablet_bootstrap.cc:654] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:42.065480 18840 log.cc:824] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:42.065754 18841 log.cc:824] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:42.066658 18847 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Bootstrap starting.
I20260807 05:02:42.067658 18840 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: No bootstrap required, opened a new log
I20260807 05:02:42.067870 18840 ts_tablet_manager.cc:1397] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:02:42.068639 18841 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: No bootstrap required, opened a new log
I20260807 05:02:42.068905 18841 ts_tablet_manager.cc:1397] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 05:02:42.069074 18847 tablet_bootstrap.cc:654] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Neither blocks nor log segments found. Creating new log.
I20260807 05:02:42.070308 18847 log.cc:824] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Log is configured to *not* fsync() on all Append() calls
I20260807 05:02:42.071816 18840 raft_consensus.cc:348] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.072047 18840 raft_consensus.cc:374] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:42.072124 18840 raft_consensus.cc:729] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8b780b571348ce8640e10adaa6bf21, State: Initialized, Role: FOLLOWER
I20260807 05:02:42.072571 18847 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: No bootstrap required, opened a new log
I20260807 05:02:42.072551 18840 consensus_queue.cc:260] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.072777 18847 ts_tablet_manager.cc:1397] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:02:42.072758 18841 raft_consensus.cc:348] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.073046 18841 raft_consensus.cc:374] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:42.073132 18841 raft_consensus.cc:729] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502be6dc279140cf92fd8b7c0ccda003, State: Initialized, Role: FOLLOWER
I20260807 05:02:42.073522 18840 ts_tablet_manager.cc:1428] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 05:02:42.073552 18841 consensus_queue.cc:260] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.073875 18414 heartbeater.cc:503] Master 127.25.214.254:40621 was elected leader, sending a full tablet report...
I20260807 05:02:42.074492 18841 ts_tablet_manager.cc:1428] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260807 05:02:42.074827 18605 heartbeater.cc:503] Master 127.25.214.254:40621 was elected leader, sending a full tablet report...
I20260807 05:02:42.077277 18847 raft_consensus.cc:348] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.077548 18847 raft_consensus.cc:374] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:02:42.077626 18847 raft_consensus.cc:729] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e725eb73124b4b42b2b1e6df2c713bb0, State: Initialized, Role: FOLLOWER
I20260807 05:02:42.078049 18847 consensus_queue.cc:260] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.078719 18815 heartbeater.cc:503] Master 127.25.214.254:40621 was elected leader, sending a full tablet report...
I20260807 05:02:42.079012 18847 ts_tablet_manager.cc:1428] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 05:02:42.246601 18816 tablet.cc:2369] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:02:42.274662 18607 tablet.cc:2369] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:02:42.292351 18415 tablet.cc:2369] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:02:42.304247 18849 raft_consensus.cc:482] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:02:42.304486 18849 raft_consensus.cc:504] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.305721 18849 leader_election.cc:288] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083), e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331)
I20260807 05:02:42.309638 18837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.306080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50227 (local address 127.25.214.194:35083)
0807 05:02:42.306222 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.306227 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.306428 (+ 201us) server_negotiation.cc:407] Connection header received
0807 05:02:42.306569 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.306572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.306619 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.306684 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:42.306964 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.307474 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.308673 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.309079 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.309194 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.309257 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.309435 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.309508 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 05:02:42.309661 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.305990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:35083 (local address 127.25.214.193:50227)
0807 05:02:42.306324 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:42.306338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:42.306462 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:42.306703 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:42.306705 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:42.306721 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:42.306852 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.306860 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.307595 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.307598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.308535 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.308546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.309194 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.309198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.309294 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.309319 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:02:42.309404 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:02:42.309486 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":25,"thread_start_us":125,"threads_started":1}
I20260807 05:02:42.309702 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.306127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:52423 (local address 127.25.214.195:39331)
0807 05:02:42.306360 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.306364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.306516 (+ 152us) server_negotiation.cc:407] Connection header received
0807 05:02:42.306659 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.306662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.306704 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.306767 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:02:42.307048 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.307541 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.308675 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.309097 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.309209 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.309266 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.309478 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.309573 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260807 05:02:42.310081 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.306006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39331 (local address 127.25.214.193:52423)
0807 05:02:42.306422 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:42.306434 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:02:42.306554 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:02:42.306793 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:02:42.306796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:02:42.306812 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:02:42.306936 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.306942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.307652 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.307655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.308530 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:02:42.308558 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.309215 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.309219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:02:42.309328 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.309351 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:02:42.309846 (+ 495us) client_negotiation.cc:240] Negotiation successful
0807 05:02:42.309928 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":1,"thread_start_us":117,"threads_started":1}
I20260807 05:02:42.310657 18538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91c0c54a70a543c18504af94c7bbf5c8" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502be6dc279140cf92fd8b7c0ccda003" is_pre_election: true
I20260807 05:02:42.310688 18736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91c0c54a70a543c18504af94c7bbf5c8" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" is_pre_election: true
I20260807 05:02:42.310999 18538 raft_consensus.cc:2454] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 0.
I20260807 05:02:42.311002 18736 raft_consensus.cc:2454] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 0.
I20260807 05:02:42.311533 18249 leader_election.cc:302] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8b780b571348ce8640e10adaa6bf21, e725eb73124b4b42b2b1e6df2c713bb0; no voters:
I20260807 05:02:42.311846 18849 raft_consensus.cc:2781] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:02:42.311937 18849 raft_consensus.cc:482] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:02:42.311983 18849 raft_consensus.cc:3037] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:42.313199 18849 raft_consensus.cc:504] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.313552 18849 leader_election.cc:288] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 election: Requested vote from peers 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083), e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331)
I20260807 05:02:42.314004 18538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91c0c54a70a543c18504af94c7bbf5c8" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502be6dc279140cf92fd8b7c0ccda003"
I20260807 05:02:42.314028 18736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91c0c54a70a543c18504af94c7bbf5c8" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
I20260807 05:02:42.314136 18538 raft_consensus.cc:3037] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:42.314157 18736 raft_consensus.cc:3037] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:02:42.315222 18538 raft_consensus.cc:2454] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 1.
I20260807 05:02:42.315285 18736 raft_consensus.cc:2454] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 1.
I20260807 05:02:42.315619 18248 leader_election.cc:302] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502be6dc279140cf92fd8b7c0ccda003, 9d8b780b571348ce8640e10adaa6bf21; no voters:
I20260807 05:02:42.315852 18849 raft_consensus.cc:2781] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:02:42.316147 18849 raft_consensus.cc:686] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 LEADER]: Becoming Leader. State: Replica: 9d8b780b571348ce8640e10adaa6bf21, State: Running, Role: LEADER
I20260807 05:02:42.316494 18849 consensus_queue.cc:237] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:02:42.320726 18134 catalog_manager.cc:5495] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "9d8b780b571348ce8640e10adaa6bf21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260807 05:02:42.343673 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.340294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59552 (local address 127.25.214.193:39629)
0807 05:02:42.340426 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:02:42.340430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:02:42.340443 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:02:42.340524 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:02:42.340526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:02:42.340600 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:02:42.340708 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:02:42.340913 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.341416 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.342222 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:02:42.342444 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:02:42.342524 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:02:42.342851 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:02:42.343286 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:02:42.343379 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 05:02:42.343480 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 05:02:42.343532 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:02:42.349634 18538 raft_consensus.cc:1261] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Refusing update from remote peer 9d8b780b571348ce8640e10adaa6bf21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:42.349633 18736 raft_consensus.cc:1261] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Refusing update from remote peer 9d8b780b571348ce8640e10adaa6bf21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:02:42.350354 18849 consensus_queue.cc:1035] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:42.350574 18855 consensus_queue.cc:1035] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:02:42.359730 18859 mvcc.cc:205] Tried to move back new op lower bound from 7315779429776531456 to 7315779429651161088. Current Snapshot: MvccSnapshot[applied={T|T < 7315779429776531456}]
I20260807 05:02:42.359925 18858 mvcc.cc:205] Tried to move back new op lower bound from 7315779429776531456 to 7315779429651161088. Current Snapshot: MvccSnapshot[applied={T|T < 7315779429776531456}]
I20260807 05:02:42.369858 18136 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:42.370029 18136 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:02:42.372607 18136 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Sending DeleteTablet for 3 replicas of tablet 91c0c54a70a543c18504af94c7bbf5c8
I20260807 05:02:42.373409 18318 tablet_service.cc:1514] Processing DeleteTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:59536
I20260807 05:02:42.373426 18503 tablet_service.cc:1514] Processing DeleteTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:33932
I20260807 05:02:42.373999 18875 tablet_replica.cc:330] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: stopping tablet replica
I20260807 05:02:42.374022 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 18224
I20260807 05:02:42.374176 18708 tablet_service.cc:1514] Processing DeleteTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:60752
I20260807 05:02:42.374365 18874 tablet_replica.cc:330] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: stopping tablet replica
I20260807 05:02:42.374749 18874 raft_consensus.cc:2229] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:42.378499 18874 raft_consensus.cc:2258] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:42.384363 18876 tablet_replica.cc:330] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: stopping tablet replica
I20260807 05:02:42.384542 18874 ts_tablet_manager.cc:1905] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:42.384738 18876 raft_consensus.cc:2229] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:02:42.385094 18876 raft_consensus.cc:2258] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:02:42.386462 18876 ts_tablet_manager.cc:1905] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:02:42.387593 18874 ts_tablet_manager.cc:1918] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:42.387712 18874 log.cc:1196] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/91c0c54a70a543c18504af94c7bbf5c8
I20260807 05:02:42.388070 18874 ts_tablet_manager.cc:1939] T 91c0c54a70a543c18504af94c7bbf5c8 P 502be6dc279140cf92fd8b7c0ccda003: Deleting consensus metadata
I20260807 05:02:42.388729 18876 ts_tablet_manager.cc:1918] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:02:42.388815 18876 log.cc:1196] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/91c0c54a70a543c18504af94c7bbf5c8
I20260807 05:02:42.389083 18876 ts_tablet_manager.cc:1939] T 91c0c54a70a543c18504af94c7bbf5c8 P e725eb73124b4b42b2b1e6df2c713bb0: Deleting consensus metadata
I20260807 05:02:42.389593 18111 catalog_manager.cc:4841] TS 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): tablet 91c0c54a70a543c18504af94c7bbf5c8 (table test-table [id=683fa242022b4f55848b78d9992f6dcb]) successfully deleted
I20260807 05:02:42.390123 18112 catalog_manager.cc:4841] TS e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): tablet 91c0c54a70a543c18504af94c7bbf5c8 (table test-table [id=683fa242022b4f55848b78d9992f6dcb]) successfully deleted
W20260807 05:02:42.391050 18113 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:39629 (error 108)
I20260807 05:02:42.391080 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 18422
I20260807 05:02:42.398280 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:02:42.397897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39629 (local address 127.0.0.1:59566)
0807 05:02:42.398079 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 05:02:42.398172 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:39629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 05:02:42.398511 18113 catalog_manager.cc:4584] TS 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193:39629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91c0c54a70a543c18504af94c7bbf5c8: Network error: Client connection negotiation failed: client connection to 127.25.214.193:39629: connect: Connection refused (error 111)
I20260807 05:02:42.404307 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 18612
I20260807 05:02:42.419819 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 18076
I20260807 05:03:02.432861 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40621
--webserver_interface=127.25.214.254
--webserver_port=46833
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:40621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:02.543483 18879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:02.543720 18879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:02.543757 18879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:02.547572 18879 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 05:03:02.547614 18879 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 05:03:02.547629 18879 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 05:03:02.547641 18879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:02.547663 18879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:02.547679 18879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:02.547696 18879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:02.547712 18879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:02.552702 18879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:40621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=46833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:02.553646 18879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:02.554594 18879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:02.567538 18889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:02.567589 18890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:02.567704 18879 server_base.cc:1034] running on GCE node
W20260807 05:03:02.567941 18895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:02.568589 18879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:02.569731 18879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:02.570906 18879 hybrid_clock.cc:648] HybridClock initialized: now 1786078982570885 us; error 30 us; skew 500 ppm
Aug 07 05:03:02 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:02.573694 18879 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:03:02.574659 18879 webserver.cc:460] Webserver started at http://127.25.214.254:46833/ using document root <none> and password file <none>
I20260807 05:03:02.575292 18879 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:02.575392 18879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:02.579313 18879 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:02.581413 18906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:02.582562 18879 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:03:02.582675 18879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "c67a64b56224415d978e9cc266708e29"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "de0ef9505deac4465f0a98307b52be87"
server_key_iv: "5d9998e75de976bc6ce058627ef82f0c"
server_key_version: "encryptionkey@0"
I20260807 05:03:02.583274 18879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:02.604210 18879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:02.607126 18879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:02.607308 18879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:02.614661 18879 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:40621
I20260807 05:03:02.614948 18994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:40621 every 8 connection(s)
I20260807 05:03:02.615828 18879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:02.620126 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 18879
I20260807 05:03:02.620637 18998 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:03:02.620667 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:39629
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:40621
--webserver_port=40325
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:03:02.622992 18998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap starting.
I20260807 05:03:02.640393 18998 log.cc:824] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:02.649133 18998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:03:02.649482 18998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap complete.
I20260807 05:03:02.653494 18998 raft_consensus.cc:348] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:02.653908 18998 raft_consensus.cc:729] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c67a64b56224415d978e9cc266708e29, State: Initialized, Role: FOLLOWER
I20260807 05:03:02.654378 18998 consensus_queue.cc:260] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:02.654505 18998 raft_consensus.cc:388] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:02.654572 18998 raft_consensus.cc:482] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:02.654670 18998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 1 FOLLOWER]: Advancing to term 2
I20260807 05:03:02.656741 18998 raft_consensus.cc:504] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:02.657084 18998 leader_election.cc:302] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c67a64b56224415d978e9cc266708e29; no voters:
I20260807 05:03:02.657387 18998 leader_election.cc:288] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 05:03:02.657500 19006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 05:03:02.657691 19006 raft_consensus.cc:686] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 LEADER]: Becoming Leader. State: Replica: c67a64b56224415d978e9cc266708e29, State: Running, Role: LEADER
I20260807 05:03:02.657997 19006 consensus_queue.cc:237] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:02.658697 18998 sys_catalog.cc:564] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:02.658998 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c67a64b56224415d978e9cc266708e29. Latest consensus state: current_term: 2 leader_uuid: "c67a64b56224415d978e9cc266708e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } } }
I20260807 05:03:02.659121 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:02.659399 19007 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c67a64b56224415d978e9cc266708e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } } }
I20260807 05:03:02.659497 19007 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:02.659500 19011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:02.664983 19011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:02.665625 19011 catalog_manager.cc:1259] Loaded cluster ID: f049594d61d745b49059f09a3e8b0395
I20260807 05:03:02.665678 19011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:02.667462 19011 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:02.668051 19011 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Loaded TSK: 0
I20260807 05:03:02.686800 19011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Generated new TSK 1
I20260807 05:03:02.687063 19011 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 05:03:02.747067 19000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:02.747336 19000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:02.747386 19000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:02.751377 19000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:02.751437 19000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:02.751498 19000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:02.756736 19000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:39629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=40325
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:02.757747 19000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:02.758742 19000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:02.768190 19058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:02.768203 19053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:02.768457 19000 server_base.cc:1034] running on GCE node
W20260807 05:03:02.768663 19056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:02.769044 19000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:02.769666 19000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:02.770833 19000 hybrid_clock.cc:648] HybridClock initialized: now 1786078982770806 us; error 44 us; skew 500 ppm
Aug 07 05:03:02 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:02.773613 19000 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:03:02.774510 19000 webserver.cc:460] Webserver started at http://127.25.214.193:40325/ using document root <none> and password file <none>
I20260807 05:03:02.775104 19000 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:02.775183 19000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:02.779335 19000 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:03:02.781661 19069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:02.783023 19000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 05:03:02.783141 19000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "9d8b780b571348ce8640e10adaa6bf21"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "a8c465e141d6a5348deb74688b6d9eed"
server_key_iv: "a888f4ff73e47ee6fbec72c21b01ce76"
server_key_version: "encryptionkey@0"
I20260807 05:03:02.783708 19000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:02.798288 19000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:02.801498 19000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:02.801684 19000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:02.802284 19000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:02.803390 19080 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 05:03:02.808734 19000 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 05:03:02.808799 19000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 05:03:02.808863 19000 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 05:03:02.810535 19000 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 05:03:02.810581 19000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 05:03:02.810894 19080 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap starting.
I20260807 05:03:02.820729 19000 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:39629
I20260807 05:03:02.820796 19248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:39629 every 8 connection(s)
I20260807 05:03:02.821666 19000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:02.828568 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 19000
I20260807 05:03:02.829034 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:35083
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:40621
--webserver_port=45785
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:03:02.829365 19080 log.cc:824] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Log is configured to *not* fsync() on all Append() calls
Aug 07 05:03:02 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:02.837404 19080 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:03:02.837772 19080 tablet_bootstrap.cc:492] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap complete.
I20260807 05:03:02.838932 19080 ts_tablet_manager.cc:1397] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Time spent bootstrapping tablet: real 0.028s user 0.024s sys 0.001s
I20260807 05:03:02.840268 19253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:02.823833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:59197 (local address 127.25.214.254:40621)
0807 05:03:02.824353 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:02.824372 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:02.824840 (+ 468us) server_negotiation.cc:407] Connection header received
0807 05:03:02.825953 (+ 1113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:02.825969 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:02.826381 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:02.826777 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:02.827761 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.829235 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.830608 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.831323 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.831486 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:02.834448 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:02.834454 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:02.834470 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:02.834503 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:02.836562 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:02.837212 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:02.837217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:02.837223 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:02.837385 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:02.837795 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:02.837798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:02.837800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:02.838236 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:02.838374 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:02.839047 (+ 673us) server_negotiation.cc:299] Negotiation successful
0807 05:03:02.839362 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":117,"threads_started":1}
I20260807 05:03:02.840322 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:02.823822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:59197)
0807 05:03:02.824646 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:02.824699 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:02.825470 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:02.826775 (+ 1305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:02.826782 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:02.827120 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:02.827583 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:02.827598 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.829439 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.829443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:02.830456 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:02.830467 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.831474 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.831478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:02.831659 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:02.832361 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:02.832381 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:02.834227 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:02.836697 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:02.836703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:02.836716 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:02.837082 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:02.837491 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:02.837494 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:02.837496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:02.837687 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:02.838361 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:02.838368 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:02.838692 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 05:03:02.838912 (+ 220us) client_negotiation.cc:240] Negotiation successful
0807 05:03:02.839354 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":176,"threads_started":1}
I20260807 05:03:02.841677 19080 raft_consensus.cc:348] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:03:02.842166 19080 raft_consensus.cc:729] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8b780b571348ce8640e10adaa6bf21, State: Initialized, Role: FOLLOWER
I20260807 05:03:02.842614 19080 consensus_queue.cc:260] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } }
I20260807 05:03:02.843231 19249 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40621
I20260807 05:03:02.843465 19249 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:02.843519 19080 ts_tablet_manager.cc:1428] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260807 05:03:02.844017 19249 heartbeater.cc:511] Master 127.25.214.254:40621 requested a full tablet report, sending...
I20260807 05:03:02.846448 18934 ts_manager.cc:194] Registered new tserver with Master: 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193:39629)
I20260807 05:03:02.849903 18934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:59197
I20260807 05:03:02.852680 19249 heartbeater.cc:503] Master 127.25.214.254:40621 was elected leader, sending a full tablet report...
Aug 07 05:03:02 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.193@KRBTEST.COM
I20260807 05:03:02.858180 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:02.849169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41578 (local address 127.25.214.193:39629)
0807 05:03:02.849829 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:02.849839 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:02.849860 (+ 21us) server_negotiation.cc:407] Connection header received
0807 05:03:02.849921 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:02.849926 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:02.850119 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:02.850244 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:02.850923 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.851615 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.852478 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.852822 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.852923 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:02.855082 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:02.855087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:02.855097 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:02.855117 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:02.856476 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:02.856972 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:02.856976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:02.856977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:02.857044 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:02.857297 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:02.857300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:02.857301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:02.857519 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:02.857616 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:02.857947 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 05:03:02.858066 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":88,"threads_started":1}
I20260807 05:03:02.858248 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:02.849115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39629 (local address 127.0.0.1:41578)
0807 05:03:02.849519 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:02.849561 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:02.849672 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:02.850268 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:02.850274 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:02.850667 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:02.850798 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:02.850807 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.851722 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.851725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:02.852369 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:02.852380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:02.852948 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:02.852952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:02.853057 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:02.853547 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:02.853559 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:02.854954 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:02.856580 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:02.856589 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:02.856594 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:02.856879 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:02.857117 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:02.857120 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:02.857122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:02.857214 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:02.857624 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:02.857629 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:02.857749 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 05:03:02.857896 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 05:03:02.858086 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":111,"threads_started":1}
I20260807 05:03:02.859148 19150 tablet_service.cc:1514] Processing DeleteTablet for tablet 91c0c54a70a543c18504af94c7bbf5c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:02:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:41578
I20260807 05:03:02.859922 19264 tablet_replica.cc:330] stopping tablet replica
I20260807 05:03:02.860251 19264 raft_consensus.cc:2229] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:02.860493 19264 raft_consensus.cc:2258] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:02.861483 19264 ts_tablet_manager.cc:1905] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:02.865769 19264 ts_tablet_manager.cc:1918] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:02.865867 19264 log.cc:1196] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal/wals/91c0c54a70a543c18504af94c7bbf5c8
I20260807 05:03:02.866137 19264 ts_tablet_manager.cc:1939] T 91c0c54a70a543c18504af94c7bbf5c8 P 9d8b780b571348ce8640e10adaa6bf21: Deleting consensus metadata
I20260807 05:03:02.867975 18918 catalog_manager.cc:4841] TS 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193:39629): tablet 91c0c54a70a543c18504af94c7bbf5c8 (table test-table [id=683fa242022b4f55848b78d9992f6dcb]) successfully deleted
W20260807 05:03:02.951229 19256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:02.951493 19256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:02.951535 19256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:02.955603 19256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:02.955693 19256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:02.955776 19256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:02.961393 19256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:35083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=45785
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:02.962522 19256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:02.963577 19256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:02.973492 19281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:02.973407 19272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:02.973511 19273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:02.973562 19256 server_base.cc:1034] running on GCE node
I20260807 05:03:02.974128 19256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:02.974799 19256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:02.976055 19256 hybrid_clock.cc:648] HybridClock initialized: now 1786078982975800 us; error 266 us; skew 500 ppm
Aug 07 05:03:02 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:02.983858 19256 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:03:02.984947 19256 webserver.cc:460] Webserver started at http://127.25.214.194:45785/ using document root <none> and password file <none>
I20260807 05:03:02.985534 19256 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:02.985630 19256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:02.989955 19256 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:02.992195 19295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:02.993454 19256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:02.993582 19256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "502be6dc279140cf92fd8b7c0ccda003"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "15c2797bea29ff86e0c28a7ef35e7a09"
server_key_iv: "c1f2ae1e99302980715f34f0ba004561"
server_key_version: "encryptionkey@0"
I20260807 05:03:02.994145 19256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:03.013702 19256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:03.017061 19256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:03.017256 19256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:03.017884 19256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:03.018748 19256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:03.018798 19256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:03.018853 19256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:03.018882 19256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:03.027619 19256 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:35083
I20260807 05:03:03.027709 19481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:35083 every 8 connection(s)
I20260807 05:03:03.028689 19256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:03.037159 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 19256
I20260807 05:03:03.037583 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:39331
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:40621
--webserver_port=34977
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 05:03:03 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078982, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:03.042420 19253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.030543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:39705 (local address 127.25.214.254:40621)
0807 05:03:03.030677 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.030681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.031553 (+ 872us) server_negotiation.cc:407] Connection header received
0807 05:03:03.032850 (+ 1297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.032854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.032928 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.033004 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:03.034213 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.034740 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.035899 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.036162 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.036256 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.038755 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:03.038758 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:03.038760 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:03.038787 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:03.040365 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.040897 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.040901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.040902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.040986 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.041314 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.041318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.041320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.041506 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:03.041608 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.042098 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.042243 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:03:03.043284 19485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.030866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:39705)
0807 05:03:03.031390 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.031436 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:03.032630 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:03.033191 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:03.033198 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:03.033566 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:03.034059 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.034074 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.034862 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.034865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.035761 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.035772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.036307 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.036312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.036492 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.037053 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:03.037070 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:03.038582 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:03.040508 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:03.040514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:03.040527 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:03.040789 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:03.041083 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:03.041085 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:03.041086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:03.041221 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:03.041609 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:03.041615 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:03.041862 (+ 247us) client_negotiation.cc:769] Sending connection context
0807 05:03:03.042032 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 05:03:03.042376 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":119,"threads_started":1}
I20260807 05:03:03.044452 19482 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40621
I20260807 05:03:03.044734 19482 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:03.045379 19482 heartbeater.cc:511] Master 127.25.214.254:40621 requested a full tablet report, sending...
I20260807 05:03:03.046612 18934 ts_manager.cc:194] Registered new tserver with Master: 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
I20260807 05:03:03.047197 18934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:39705
W20260807 05:03:03.153123 19487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:03.153391 19487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:03.153439 19487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:03.157480 19487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:03.157539 19487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:03.157605 19487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:03.162873 19487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:39331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=34977
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:03.163882 19487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:03.165011 19487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:03.174692 19495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:03.174870 19487 server_base.cc:1034] running on GCE node
W20260807 05:03:03.174695 19499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:03.174700 19497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:03.175441 19487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:03.176111 19487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:03.177284 19487 hybrid_clock.cc:648] HybridClock initialized: now 1786078983177257 us; error 45 us; skew 500 ppm
Aug 07 05:03:03 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078983, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:03.179968 19487 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:03:03.180867 19487 webserver.cc:460] Webserver started at http://127.25.214.195:34977/ using document root <none> and password file <none>
I20260807 05:03:03.181421 19487 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:03.181504 19487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:03.185561 19487 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:03.187755 19507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:03.189081 19487 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:03.189200 19487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "d7eac91a51cfd6613e0ea54bee52c44c"
server_key_iv: "2c7029dd5f42d6c76cb3dc6ecc207d6f"
server_key_version: "encryptionkey@0"
I20260807 05:03:03.189746 19487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:03.202749 19487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:03.205513 19487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:03.205693 19487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:03.206295 19487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:03.207161 19487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:03.207211 19487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:03.207266 19487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:03.207293 19487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:03.215816 19487 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:39331
I20260807 05:03:03.215844 19671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:39331 every 8 connection(s)
I20260807 05:03:03.216848 19487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:03.225284 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 19487
Aug 07 05:03:03 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786078983, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:03.230018 19253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.218726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:47357 (local address 127.25.214.254:40621)
0807 05:03:03.218875 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.218879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.219881 (+ 1002us) server_negotiation.cc:407] Connection header received
0807 05:03:03.220782 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.220786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.220845 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.220916 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:03.222102 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.222662 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.223865 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.224111 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.224205 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.226729 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:03.226732 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:03.226736 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:03.226762 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:03.228041 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.228567 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.228571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.228572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.228648 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.228967 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.228970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.228972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.229149 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:03.229239 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.229778 (+ 539us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.229891 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 05:03:03.230850 19676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.219090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:47357)
0807 05:03:03.219731 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.219772 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:03.220576 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:03.221115 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:03.221121 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:03.221467 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:03.221948 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.221961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.222787 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.222790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.223744 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.223755 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.224253 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.224257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.224422 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.224987 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:03.225004 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:03.226566 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:03.228192 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:03.228198 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:03.228214 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:03.228464 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:03.228733 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:03.228736 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:03.228738 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:03.228875 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:03.229252 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:03.229259 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:03.229500 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 05:03:03.229706 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 05:03:03.229990 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":117,"threads_started":1}
I20260807 05:03:03.231997 19672 heartbeater.cc:347] Connected to a master server at 127.25.214.254:40621
I20260807 05:03:03.232262 19672 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:03.232748 19672 heartbeater.cc:511] Master 127.25.214.254:40621 requested a full tablet report, sending...
I20260807 05:03:03.233772 18934 ts_manager.cc:194] Registered new tserver with Master: e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331)
I20260807 05:03:03.234289 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.225967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36692 (local address 127.25.214.254:40621)
0807 05:03:03.226237 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.226241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.226412 (+ 171us) server_negotiation.cc:407] Connection header received
0807 05:03:03.226546 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.226550 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.226602 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.226679 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:03.227432 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.227968 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.228874 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.229118 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.229216 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.230996 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:03.231000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:03.231003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:03.231030 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:03.232571 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.233010 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.233014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.233016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.233106 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.233410 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.233414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.233416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.233604 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:03.233806 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.233988 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.234113 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":78,"threads_started":1}
I20260807 05:03:03.234416 18934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:47357
I20260807 05:03:03.236021 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:03.240163 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.236640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36694 (local address 127.25.214.254:40621)
0807 05:03:03.236770 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.236775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.236950 (+ 175us) server_negotiation.cc:407] Connection header received
0807 05:03:03.237128 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.237131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.237221 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.237311 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:03.237571 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.238071 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.238940 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.239176 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.239278 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.239603 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:03.239735 (+ 132us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 05:03:03.240001 (+ 266us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36694: token expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 05:03:03.240238 19677 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36694: token expired
W20260807 05:03:03.240587 18820 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.214.254:40621)
I20260807 05:03:03.246847 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.240952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36710 (local address 127.25.214.254:40621)
0807 05:03:03.241063 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.241068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.241080 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:03:03.241149 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.241151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.241186 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.241244 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:03.241756 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.242233 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.242941 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.243142 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.243207 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.244401 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:03.244404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:03.244406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:03.244423 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:03.245582 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.245977 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.245979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.245980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.246060 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:03.246247 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:03.246249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:03.246250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:03.246403 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:03.246493 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.246647 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.246737 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 05:03:03.249249 18933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:03.252493 18933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:03.260528 19150 tablet_service.cc:1467] Processing CreateTablet for tablet e8f291bc403e44a798cdb6f604db0e86 (DEFAULT_TABLE table=test-table [id=46b632ede4cf46ce9e4e9949dd3ccfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:03.261346 19150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f291bc403e44a798cdb6f604db0e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:03.264371 19080 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap starting.
I20260807 05:03:03.265314 19080 tablet_bootstrap.cc:654] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:03.265394 19688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.259651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:35083 (local address 127.0.0.1:47390)
0807 05:03:03.259944 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.259958 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:03.260116 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:03.261095 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:03.261098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:03.261112 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:03.261397 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.261404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.262771 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.262775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.263884 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.263896 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.265028 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.265032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.265120 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.265162 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 05:03:03.265211 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 05:03:03.265268 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":1,"thread_start_us":142,"threads_started":1}
I20260807 05:03:03.265498 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.260272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47390 (local address 127.25.214.194:35083)
0807 05:03:03.260589 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.260601 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.260625 (+ 24us) server_negotiation.cc:407] Connection header received
0807 05:03:03.260694 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.260697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.260938 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.261544 (+ 606us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:03.261722 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.262645 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.264025 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.264915 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.265041 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.265185 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.265259 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.265356 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":115,"threads_started":1}
I20260807 05:03:03.266692 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.259406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39331 (local address 127.0.0.1:46650)
0807 05:03:03.259594 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.259610 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:03.259691 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:03.261056 (+ 1365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:03.261059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:03.261079 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:03.261217 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.261223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.262491 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.262494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.263383 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.263393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.266301 (+ 2908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.266305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.266404 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.266429 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:03:03.266514 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:03:03.266593 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":17}
I20260807 05:03:03.266916 19080 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: No bootstrap required, opened a new log
I20260807 05:03:03.267014 19080 ts_tablet_manager.cc:1397] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 05:03:03.267470 19080 raft_consensus.cc:348] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.267601 19080 raft_consensus.cc:374] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:03.267647 19080 raft_consensus.cc:729] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8b780b571348ce8640e10adaa6bf21, State: Initialized, Role: FOLLOWER
I20260807 05:03:03.267771 19080 consensus_queue.cc:260] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.268520 19080 ts_tablet_manager.cc:1428] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 05:03:03.268952 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.259904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46650 (local address 127.25.214.195:39331)
0807 05:03:03.260494 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.260507 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.260532 (+ 25us) server_negotiation.cc:407] Connection header received
0807 05:03:03.260634 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.260639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.260886 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.261064 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:03.261310 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.262369 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.263517 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.264165 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.266307 (+ 2142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.266434 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.268700 (+ 2266us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.268809 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":228,"threads_started":1}
I20260807 05:03:03.268862 19375 tablet_service.cc:1467] Processing CreateTablet for tablet e8f291bc403e44a798cdb6f604db0e86 (DEFAULT_TABLE table=test-table [id=46b632ede4cf46ce9e4e9949dd3ccfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:03.270001 19375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f291bc403e44a798cdb6f604db0e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:03.271759 19577 tablet_service.cc:1467] Processing CreateTablet for tablet e8f291bc403e44a798cdb6f604db0e86 (DEFAULT_TABLE table=test-table [id=46b632ede4cf46ce9e4e9949dd3ccfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:03.272770 19577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f291bc403e44a798cdb6f604db0e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:03.276546 19695 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Bootstrap starting.
I20260807 05:03:03.278726 19695 tablet_bootstrap.cc:654] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:03.279003 19696 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Bootstrap starting.
I20260807 05:03:03.279480 19695 log.cc:824] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:03.281281 19696 tablet_bootstrap.cc:654] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:03.281389 19695 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: No bootstrap required, opened a new log
I20260807 05:03:03.281564 19695 ts_tablet_manager.cc:1397] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:03:03.282015 19696 log.cc:824] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:03.283746 19696 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: No bootstrap required, opened a new log
I20260807 05:03:03.283923 19696 ts_tablet_manager.cc:1397] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 05:03:03.284690 19695 raft_consensus.cc:348] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.284909 19695 raft_consensus.cc:374] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:03.284953 19695 raft_consensus.cc:729] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502be6dc279140cf92fd8b7c0ccda003, State: Initialized, Role: FOLLOWER
I20260807 05:03:03.285367 19695 consensus_queue.cc:260] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.286072 19482 heartbeater.cc:503] Master 127.25.214.254:40621 was elected leader, sending a full tablet report...
I20260807 05:03:03.286310 19695 ts_tablet_manager.cc:1428] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:03:03.287185 19696 raft_consensus.cc:348] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.287442 19696 raft_consensus.cc:374] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:03.287500 19696 raft_consensus.cc:729] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e725eb73124b4b42b2b1e6df2c713bb0, State: Initialized, Role: FOLLOWER
I20260807 05:03:03.287945 19696 consensus_queue.cc:260] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.288622 19672 heartbeater.cc:503] Master 127.25.214.254:40621 was elected leader, sending a full tablet report...
I20260807 05:03:03.288878 19696 ts_tablet_manager.cc:1428] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
W20260807 05:03:03.322876 19252 tablet.cc:2369] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:03:03.385020 19261 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:03.385253 19261 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.386515 19261 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
I20260807 05:03:03.391865 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.387256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45399 (local address 127.25.214.194:35083)
0807 05:03:03.387383 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.387387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.387401 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:03:03.387447 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.387450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.387493 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.387570 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:03.387979 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.388802 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.390556 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.391177 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.391288 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.391343 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.391658 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.391729 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:03:03.391862 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.387220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:60527 (local address 127.25.214.195:39331)
0807 05:03:03.387356 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.387361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.387375 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:03:03.387442 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.387445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.387490 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.387568 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:03.387999 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.388805 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.390556 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.391170 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.391288 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.391352 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.391658 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.391729 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 05:03:03.391912 19702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.386784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:35083 (local address 127.25.214.193:45399)
0807 05:03:03.387142 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.387158 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:03.387255 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:03.387622 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:03.387625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:03.387672 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:03.387870 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.387878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.388920 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.388924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.390425 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.390437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.391284 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.391288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.391468 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.391544 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 05:03:03.391623 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 05:03:03.391714 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":175,"spinlock_wait_cycles":34688,"thread_start_us":83,"threads_started":1}
I20260807 05:03:03.391927 19701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.386740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39331 (local address 127.25.214.193:60527)
0807 05:03:03.387032 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.387046 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:03.387167 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:03.387622 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:03.387625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:03.387674 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:03.387871 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.387878 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.388920 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.388924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.390425 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:03.390437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.391284 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.391288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:03.391465 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.391546 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 05:03:03.391623 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 05:03:03.391714 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":256,"spinlock_wait_cycles":12032,"thread_start_us":105,"threads_started":1}
I20260807 05:03:03.392599 19406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f291bc403e44a798cdb6f604db0e86" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502be6dc279140cf92fd8b7c0ccda003" is_pre_election: true
I20260807 05:03:03.392616 19606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f291bc403e44a798cdb6f604db0e86" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" is_pre_election: true
I20260807 05:03:03.392944 19606 raft_consensus.cc:2454] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 0.
I20260807 05:03:03.392944 19406 raft_consensus.cc:2454] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 0.
I20260807 05:03:03.393499 19074 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502be6dc279140cf92fd8b7c0ccda003, 9d8b780b571348ce8640e10adaa6bf21; no voters:
I20260807 05:03:03.393792 19261 raft_consensus.cc:2781] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:03.393893 19261 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:03.393952 19261 raft_consensus.cc:3037] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:03.395085 19261 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.395474 19261 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 election: Requested vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
I20260807 05:03:03.395848 19406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f291bc403e44a798cdb6f604db0e86" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502be6dc279140cf92fd8b7c0ccda003"
I20260807 05:03:03.395843 19606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f291bc403e44a798cdb6f604db0e86" candidate_uuid: "9d8b780b571348ce8640e10adaa6bf21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
I20260807 05:03:03.395980 19606 raft_consensus.cc:3037] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:03.395980 19406 raft_consensus.cc:3037] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:03.397310 19406 raft_consensus.cc:2454] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 1.
I20260807 05:03:03.397321 19606 raft_consensus.cc:2454] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8b780b571348ce8640e10adaa6bf21 in term 1.
I20260807 05:03:03.397650 19075 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 502be6dc279140cf92fd8b7c0ccda003, 9d8b780b571348ce8640e10adaa6bf21, e725eb73124b4b42b2b1e6df2c713bb0; no voters:
I20260807 05:03:03.397881 19261 raft_consensus.cc:2781] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:03.398056 19261 raft_consensus.cc:686] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 LEADER]: Becoming Leader. State: Replica: 9d8b780b571348ce8640e10adaa6bf21, State: Running, Role: LEADER
I20260807 05:03:03.398303 19261 consensus_queue.cc:237] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:03.401526 18934 catalog_manager.cc:5495] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "9d8b780b571348ce8640e10adaa6bf21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } health_report { overall_health: HEALTHY } } }
I20260807 05:03:03.418530 19705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.414973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41582 (local address 127.25.214.193:39629)
0807 05:03:03.415304 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:03.415311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:03.415321 (+ 10us) server_negotiation.cc:407] Connection header received
0807 05:03:03.415390 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:03.415392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:03.415443 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:03.415547 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:03.415788 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.416327 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.417129 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:03.417345 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:03.417430 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:03.417708 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:03.418140 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:03.418241 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:03.418313 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 05:03:03.418366 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":136,"threads_started":1}
I20260807 05:03:03.422397 19606 raft_consensus.cc:1261] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Refusing update from remote peer 9d8b780b571348ce8640e10adaa6bf21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:03.422397 19406 raft_consensus.cc:1261] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Refusing update from remote peer 9d8b780b571348ce8640e10adaa6bf21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:03.423080 19703 consensus_queue.cc:1035] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:03.423261 19261 consensus_queue.cc:1035] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:03.430653 19707 mvcc.cc:205] Tried to move back new op lower bound from 7315779516092190720 to 7315779516002324480. Current Snapshot: MvccSnapshot[applied={T|T < 7315779516092190720}]
I20260807 05:03:03.439198 18934 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:03.439389 18934 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:03.441705 18934 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Sending DeleteTablet for 3 replicas of tablet e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:03.442307 19577 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f291bc403e44a798cdb6f604db0e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:03 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:46650
I20260807 05:03:03.442399 19375 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f291bc403e44a798cdb6f604db0e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:03 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:47390
I20260807 05:03:03.442456 19150 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f291bc403e44a798cdb6f604db0e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:03 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:41578
I20260807 05:03:03.442878 19719 tablet_replica.cc:330] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: stopping tablet replica
I20260807 05:03:03.443010 19720 tablet_replica.cc:330] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: stopping tablet replica
I20260807 05:03:03.443027 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 19000
I20260807 05:03:03.443183 19720 raft_consensus.cc:2229] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:03:03.443297 19719 raft_consensus.cc:2229] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:03.443697 19719 raft_consensus.cc:2258] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:03.449113 19719 ts_tablet_manager.cc:1905] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:03.451380 19719 ts_tablet_manager.cc:1918] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:03.451483 19719 log.cc:1196] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:03.451830 19719 ts_tablet_manager.cc:1939] T e8f291bc403e44a798cdb6f604db0e86 P e725eb73124b4b42b2b1e6df2c713bb0: Deleting consensus metadata
I20260807 05:03:03.451989 19722 tablet_replica.cc:330] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: stopping tablet replica
I20260807 05:03:03.452365 19722 raft_consensus.cc:2229] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:03.452718 19722 raft_consensus.cc:2258] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:03.453128 18915 catalog_manager.cc:4841] TS e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): tablet e8f291bc403e44a798cdb6f604db0e86 (table test-table [id=46b632ede4cf46ce9e4e9949dd3ccfd1]) successfully deleted
I20260807 05:03:03.454164 19722 ts_tablet_manager.cc:1905] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:03.456296 19722 ts_tablet_manager.cc:1918] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:03.456389 19722 log.cc:1196] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:03.456697 19722 ts_tablet_manager.cc:1939] T e8f291bc403e44a798cdb6f604db0e86 P 502be6dc279140cf92fd8b7c0ccda003: Deleting consensus metadata
I20260807 05:03:03.457824 18912 catalog_manager.cc:4841] TS 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): tablet e8f291bc403e44a798cdb6f604db0e86 (table test-table [id=46b632ede4cf46ce9e4e9949dd3ccfd1]) successfully deleted
W20260807 05:03:03.458238 18918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:39629 (error 108)
I20260807 05:03:03.458528 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 19256
I20260807 05:03:03.461949 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:03.461606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39629 (local address 127.0.0.1:41590)
0807 05:03:03.461792 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:03.461861 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:39629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260807 05:03:03.462158 18918 catalog_manager.cc:4584] TS 9d8b780b571348ce8640e10adaa6bf21 (127.25.214.193:39629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8f291bc403e44a798cdb6f604db0e86: Network error: Client connection negotiation failed: client connection to 127.25.214.193:39629: connect: Connection refused (error 111)
I20260807 05:03:03.470142 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 19487
I20260807 05:03:03.483714 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 18879
I20260807 05:03:23.497990 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40621
--webserver_interface=127.25.214.254
--webserver_port=46833
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:40621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:23.614277 19726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:23.614570 19726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:23.614622 19726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:23.618721 19726 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 05:03:23.618780 19726 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 05:03:23.618794 19726 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 05:03:23.618808 19726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:23.618825 19726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:23.618853 19726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:23.618871 19726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:23.618891 19726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:23.624279 19726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:40621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:40621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=46833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:23.625344 19726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:23.626397 19726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:23.635589 19734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:23.635583 19735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:23.635797 19726 server_base.cc:1034] running on GCE node
W20260807 05:03:23.635583 19739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:23.636554 19726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:23.637837 19726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:23.638998 19726 hybrid_clock.cc:648] HybridClock initialized: now 1786079003638985 us; error 30 us; skew 500 ppm
Aug 07 05:03:23 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:23.645635 19726 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:03:23.646751 19726 webserver.cc:460] Webserver started at http://127.25.214.254:46833/ using document root <none> and password file <none>
I20260807 05:03:23.647372 19726 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:23.647449 19726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:23.651786 19726 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:03:23.654268 19753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:23.655750 19726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 05:03:23.655912 19726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "c67a64b56224415d978e9cc266708e29"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "de0ef9505deac4465f0a98307b52be87"
server_key_iv: "5d9998e75de976bc6ce058627ef82f0c"
server_key_version: "encryptionkey@0"
I20260807 05:03:23.656623 19726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:23.679898 19726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:23.682966 19726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:23.683166 19726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:23.690958 19726 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:40621
I20260807 05:03:23.691244 19831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:40621 every 8 connection(s)
I20260807 05:03:23.692200 19726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:23.696759 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 19726
I20260807 05:03:23.696992 19833 sys_catalog.cc:263] Verifying existing consensus state
I20260807 05:03:23.697283 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:39629
--local_ip_for_outbound_sockets=127.25.214.193
--tserver_master_addrs=127.25.214.254:40621
--webserver_port=40325
--webserver_interface=127.25.214.193
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:03:23.699193 19833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap starting.
I20260807 05:03:23.717176 19833 log.cc:824] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:23.729242 19833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:03:23.729640 19833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: Bootstrap complete.
I20260807 05:03:23.733696 19833 raft_consensus.cc:348] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:23.734108 19833 raft_consensus.cc:729] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c67a64b56224415d978e9cc266708e29, State: Initialized, Role: FOLLOWER
I20260807 05:03:23.734601 19833 consensus_queue.cc:260] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:23.734719 19833 raft_consensus.cc:388] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:23.734782 19833 raft_consensus.cc:482] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:23.734884 19833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 2 FOLLOWER]: Advancing to term 3
I20260807 05:03:23.737021 19833 raft_consensus.cc:504] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:23.737354 19833 leader_election.cc:302] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c67a64b56224415d978e9cc266708e29; no voters:
I20260807 05:03:23.737740 19833 leader_election.cc:288] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 05:03:23.737851 19839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 05:03:23.738065 19839 raft_consensus.cc:686] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [term 3 LEADER]: Becoming Leader. State: Replica: c67a64b56224415d978e9cc266708e29, State: Running, Role: LEADER
I20260807 05:03:23.738462 19839 consensus_queue.cc:237] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } }
I20260807 05:03:23.739207 19833 sys_catalog.cc:564] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:23.740062 19841 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c67a64b56224415d978e9cc266708e29. Latest consensus state: current_term: 3 leader_uuid: "c67a64b56224415d978e9cc266708e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } } }
I20260807 05:03:23.740128 19840 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c67a64b56224415d978e9cc266708e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67a64b56224415d978e9cc266708e29" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 40621 } } }
I20260807 05:03:23.740234 19841 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:23.740252 19840 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:23.744434 19857 catalog_manager.cc:1259] Loaded cluster ID: f049594d61d745b49059f09a3e8b0395
I20260807 05:03:23.744493 19857 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: loading cluster ID for follower catalog manager: success
I20260807 05:03:23.746764 19857 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c67a64b56224415d978e9cc266708e29: acquiring CA information for follower catalog manager: success
F20260807 05:03:23.747747 19857 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f70aedda9ad google::LogMessage::Fail() at ??:0
@ 0x7f70aeddd88a google::LogMessage::SendToLog() at ??:0
@ 0x7f70aedda4de google::LogMessage::Flush() at ??:0
@ 0x7f70aeddba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f70b1a9e18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f70b973f989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f70b971c023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f70b971c54b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f70b9715652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f70b97149e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7f70b975b541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f70b101d512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f70b26616db start_thread at ??:0
@ 0x7f70ad8d861f clone at ??:0
W20260807 05:03:23.834268 19835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:23.834525 19835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:23.834568 19835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:23.838586 19835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:23.838647 19835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:23.838708 19835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:23.844116 19835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:39629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=40325
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:23.845304 19835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:23.846375 19835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:23.856364 19889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:23.856369 19888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:23.856685 19891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:23.856669 19835 server_base.cc:1034] running on GCE node
I20260807 05:03:23.857174 19835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:23.857812 19835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:23.858982 19835 hybrid_clock.cc:648] HybridClock initialized: now 1786079003858954 us; error 47 us; skew 500 ppm
Aug 07 05:03:23 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:23.861740 19835 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:03:23.862641 19835 webserver.cc:460] Webserver started at http://127.25.214.193:40325/ using document root <none> and password file <none>
I20260807 05:03:23.863181 19835 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:23.863242 19835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:23.867250 19835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:03:23.869622 19904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:23.870980 19835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 05:03:23.871093 19835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "9d8b780b571348ce8640e10adaa6bf21"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "a8c465e141d6a5348deb74688b6d9eed"
server_key_iv: "a888f4ff73e47ee6fbec72c21b01ce76"
server_key_version: "encryptionkey@0"
I20260807 05:03:23.871646 19835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:23.889256 19835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:23.892527 19835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:23.892716 19835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:23.893329 19835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:23.894491 19917 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 05:03:23.900812 19835 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 05:03:23.900923 19835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.000s
I20260807 05:03:23.901000 19835 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 05:03:23.902866 19835 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 05:03:23.902931 19835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 05:03:23.903323 19917 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap starting.
I20260807 05:03:23.913105 19835 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:39629
I20260807 05:03:23.913357 20078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:39629 every 8 connection(s)
I20260807 05:03:23.914187 19835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:23.915283 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 19835
I20260807 05:03:23.915706 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:35083
--local_ip_for_outbound_sockets=127.25.214.194
--tserver_master_addrs=127.25.214.254:40621
--webserver_port=45785
--webserver_interface=127.25.214.194
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:03:23.926505 19917 log.cc:824] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:23.936673 19917 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 05:03:23.937142 19917 tablet_bootstrap.cc:492] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Bootstrap complete.
I20260807 05:03:23.938560 19917 ts_tablet_manager.cc:1397] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Time spent bootstrapping tablet: real 0.036s user 0.025s sys 0.008s
I20260807 05:03:23.941936 19917 raft_consensus.cc:348] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:23.942483 19917 raft_consensus.cc:729] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8b780b571348ce8640e10adaa6bf21, State: Initialized, Role: FOLLOWER
I20260807 05:03:23.943027 19917 consensus_queue.cc:260] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:23.944155 19917 ts_tablet_manager.cc:1428] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260807 05:03:23.957886 20083 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:03:23.917384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:39043)
0807 05:03:23.918754 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:23.918821 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:23.919776 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:23.957121 (+ 37345us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1120,"thread_start_us":182,"threads_started":1}
W20260807 05:03:23.958398 20079 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:40621 (0 consecutive failures): Network error: Failed to ping master at 127.25.214.254:40621: Client connection negotiation failed: client connection to 127.25.214.254:40621: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 05:03:23.959170 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:23.958901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:40409)
0807 05:03:23.959040 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:23.959109 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 05:03:23.959810 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:23.959615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:51471)
0807 05:03:23.959716 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:23.959760 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 05:03:23.959968 20079 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:03:24.036871 20081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:24.037165 20081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:24.037228 20081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:24.041321 20081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:24.041391 20081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:24.041472 20081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:24.046953 20081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:35083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=45785
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:24.048240 20081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:24.049362 20081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:03:24.059540 20081 server_base.cc:1034] running on GCE node
W20260807 05:03:24.059476 20091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:24.059491 20093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:24.059479 20096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:24.060235 20081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:24.060997 20081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:24.062173 20081 hybrid_clock.cc:648] HybridClock initialized: now 1786079004062142 us; error 50 us; skew 500 ppm
Aug 07 05:03:24 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079004, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:24.065357 20081 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:03:24.066377 20081 webserver.cc:460] Webserver started at http://127.25.214.194:45785/ using document root <none> and password file <none>
I20260807 05:03:24.066980 20081 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:24.067056 20081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:24.071091 20081 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 05:03:24.073277 20103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:24.074584 20081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:03:24.074766 20081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "502be6dc279140cf92fd8b7c0ccda003"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "15c2797bea29ff86e0c28a7ef35e7a09"
server_key_iv: "c1f2ae1e99302980715f34f0ba004561"
server_key_version: "encryptionkey@0"
I20260807 05:03:24.075361 20081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:24.086474 20081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:24.089840 20081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:24.090036 20081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:24.090675 20081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:24.091569 20081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:24.091619 20081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:24.091677 20081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:24.091706 20081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:24.101305 20081 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:35083
I20260807 05:03:24.101327 20285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:35083 every 8 connection(s)
I20260807 05:03:24.102509 20081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:24.104838 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 20081
I20260807 05:03:24.105332 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:39331
--local_ip_for_outbound_sockets=127.25.214.195
--tserver_master_addrs=127.25.214.254:40621
--webserver_port=34977
--webserver_interface=127.25.214.195
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:03:24.106849 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.105115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:44517)
0807 05:03:24.105999 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.106116 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":171,"threads_started":1}
W20260807 05:03:24.107347 20286 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:40621 (0 consecutive failures): Network error: Failed to ping master at 127.25.214.254:40621: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
I20260807 05:03:24.107986 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.107737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:59711)
0807 05:03:24.107858 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.107916 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 05:03:24.108675 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.108454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:46315)
0807 05:03:24.108568 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.108616 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 05:03:24.108850 20286 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 05:03:24.219920 20290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:24.220281 20290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:24.220329 20290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:24.224512 20290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:24.224589 20290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:24.224649 20290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:24.230154 20290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:39331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=34977
--tserver_master_addrs=127.25.214.254:40621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:24.231240 20290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:24.232262 20290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:24.242038 20298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:24.242079 20290 server_base.cc:1034] running on GCE node
W20260807 05:03:24.242056 20299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:24.242036 20302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:24.242846 20290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:24.243566 20290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:24.244727 20290 hybrid_clock.cc:648] HybridClock initialized: now 1786079004244709 us; error 35 us; skew 500 ppm
Aug 07 05:03:24 dist-test-slave-lgr5 krb5kdc[18054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079004, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:24.247607 20290 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:03:24.248662 20290 webserver.cc:460] Webserver started at http://127.25.214.195:34977/ using document root <none> and password file <none>
I20260807 05:03:24.249225 20290 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:24.249287 20290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:24.253186 20290 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:24.255196 20311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:24.256517 20290 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:24.256628 20290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "e725eb73124b4b42b2b1e6df2c713bb0"
format_stamp: "Formatted at 2026-08-07 05:02:41 on dist-test-slave-lgr5"
server_key: "d7eac91a51cfd6613e0ea54bee52c44c"
server_key_iv: "2c7029dd5f42d6c76cb3dc6ecc207d6f"
server_key_version: "encryptionkey@0"
I20260807 05:03:24.257179 20290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:24.282298 20290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:24.285359 20290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:24.285540 20290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:24.286135 20290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:24.286938 20290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:24.286993 20290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:24.287048 20290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:24.287076 20290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:24.295886 20290 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:39331
I20260807 05:03:24.295920 20481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:39331 every 8 connection(s)
I20260807 05:03:24.296887 20290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:24.300536 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.298993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:53839)
0807 05:03:24.299664 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.299776 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":112,"threads_started":1}
W20260807 05:03:24.300946 20482 heartbeater.cc:644] Failed to heartbeat to 127.25.214.254:40621 (0 consecutive failures): Network error: Failed to ping master at 127.25.214.254:40621: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
I20260807 05:03:24.301509 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.301312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:46633)
0807 05:03:24.301408 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.301456 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 05:03:24.302039 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.301874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:39859)
0807 05:03:24.301951 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.301989 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 05:03:24.302196 20482 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 05:03:24.303483 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 20290
I20260807 05:03:24.961186 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:24.960677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:35467)
0807 05:03:24.960964 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:24.961048 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
I20260807 05:03:25.109992 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.109513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:51319)
0807 05:03:25.109808 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:25.109872 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":85,"threads_started":1}
I20260807 05:03:25.303195 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.302763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:37355)
0807 05:03:25.303037 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:25.303093 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":102,"threads_started":1}
I20260807 05:03:25.335995 20491 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:25.336228 20491 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:25.337291 20491 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
Aug 07 05:03:25 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.195@KRBTEST.COM
Aug 07 05:03:25 dist-test-slave-lgr5 krb5kdc[18054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079003, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.194@KRBTEST.COM
I20260807 05:03:25.350241 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.337519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:39331 (local address 127.25.214.193:58373)
0807 05:03:25.337704 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:25.337718 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:25.337823 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:25.339536 (+ 1713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:25.339542 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:25.340100 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:25.340627 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:25.340644 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.341885 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.341888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:25.342818 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:25.342829 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.343503 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.343507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:25.343688 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:25.344355 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:25.344367 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:25.345773 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:25.347838 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:25.347844 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:25.347856 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:25.348259 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:25.348576 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:25.348579 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:25.348581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:25.348731 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:25.349316 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:25.349321 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:25.349557 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 05:03:25.349712 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 05:03:25.350059 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":147,"spinlock_wait_cycles":32512}
I20260807 05:03:25.350292 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.337763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:58373 (local address 127.25.214.195:39331)
0807 05:03:25.338173 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:25.338192 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:25.338225 (+ 33us) server_negotiation.cc:407] Connection header received
0807 05:03:25.338851 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:25.338856 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:25.339178 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:25.339450 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:25.340797 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.341742 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.342938 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.343380 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.343536 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:25.346013 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:25.346021 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:25.346038 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:25.346072 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:25.347723 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:25.348368 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:25.348373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:25.348377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:25.348483 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:25.348828 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:25.348831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:25.348833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:25.349202 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:25.349319 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:25.349860 (+ 541us) server_negotiation.cc:299] Negotiation successful
0807 05:03:25.350106 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":94,"threads_started":1}
I20260807 05:03:25.350790 20494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.337725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:43241 (local address 127.25.214.194:35083)
0807 05:03:25.338085 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:25.338106 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:25.338144 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:03:25.338826 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:25.338831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:25.339178 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:25.339450 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:25.340778 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.341747 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.342936 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.343380 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.343519 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:25.346278 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:25.346282 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:25.346292 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:25.346317 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:25.347816 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:25.348355 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:25.348361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:25.348367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:25.348484 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:25.348842 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:25.348846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:25.348847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:25.349203 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:25.349319 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:25.349859 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 05:03:25.350619 (+ 760us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":109,"threads_started":1}
I20260807 05:03:25.350286 20493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.337546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:35083 (local address 127.25.214.193:43241)
0807 05:03:25.337893 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:25.337907 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:25.338024 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:25.339863 (+ 1839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:25.339866 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:25.340171 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:25.340625 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:25.340643 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.341884 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.341888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:25.342822 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:25.342832 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:25.343495 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:25.343499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:25.343688 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:25.344303 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:25.344318 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:25.346106 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:25.347921 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:25.347924 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:25.347925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:25.348251 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:25.348577 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:25.348581 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:25.348583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:25.348741 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:25.349316 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:25.349322 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:25.349558 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 05:03:25.349711 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 05:03:25.350132 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":308,"spinlock_wait_cycles":34688,"thread_start_us":85,"threads_started":1}
W20260807 05:03:25.353188 19908 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
W20260807 05:03:25.353803 19909 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:25.353896 19909 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8b780b571348ce8640e10adaa6bf21; no voters: 502be6dc279140cf92fd8b7c0ccda003, e725eb73124b4b42b2b1e6df2c713bb0
I20260807 05:03:25.354122 20491 raft_consensus.cc:2726] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:03:25.962442 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:25.961957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:57429)
0807 05:03:25.962258 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:25.962335 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":80,"threads_started":1}
I20260807 05:03:26.111209 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:26.110771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:48389)
0807 05:03:26.111031 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:26.111101 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":75,"threads_started":1}
I20260807 05:03:26.304498 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:26.304001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:56987)
0807 05:03:26.304302 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:26.304374 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":96,"threads_started":1}
I20260807 05:03:26.963610 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:26.963203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:45341)
0807 05:03:26.963448 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:26.963507 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":75,"threads_started":1}
I20260807 05:03:27.037202 20503 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:27.037361 20503 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:27.037789 20503 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
W20260807 05:03:27.038697 19908 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
W20260807 05:03:27.038818 19909 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:27.038919 19909 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8b780b571348ce8640e10adaa6bf21; no voters: 502be6dc279140cf92fd8b7c0ccda003, e725eb73124b4b42b2b1e6df2c713bb0
I20260807 05:03:27.039083 20503 raft_consensus.cc:2726] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:03:27.112703 20504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:27.112192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:36297)
0807 05:03:27.112501 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:27.112558 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":95,"threads_started":1}
I20260807 05:03:27.305819 20505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:27.305329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:56487)
0807 05:03:27.305643 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:27.305707 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":98,"threads_started":1}
I20260807 05:03:27.965034 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:27.964522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:45783)
0807 05:03:27.964855 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:27.964923 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":87,"threads_started":1}
I20260807 05:03:28.113996 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:28.113546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:45765)
0807 05:03:28.113817 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:28.113888 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":88,"threads_started":1}
I20260807 05:03:28.306941 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:28.306554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:57585)
0807 05:03:28.306789 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:28.306845 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260807 05:03:28.966445 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:28.965954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:59503)
0807 05:03:28.966280 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:28.966342 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":81,"threads_started":1}
I20260807 05:03:29.115226 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:29.114779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:36937)
0807 05:03:29.115048 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:29.115123 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
I20260807 05:03:29.308175 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:29.307728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:42063)
0807 05:03:29.307982 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:29.308035 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":81,"threads_started":1}
I20260807 05:03:29.783340 20514 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:29.783479 20514 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:29.783901 20514 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
W20260807 05:03:29.784732 19908 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
W20260807 05:03:29.784838 19909 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:29.784926 19909 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8b780b571348ce8640e10adaa6bf21; no voters: 502be6dc279140cf92fd8b7c0ccda003, e725eb73124b4b42b2b1e6df2c713bb0
I20260807 05:03:29.785075 20514 raft_consensus.cc:2726] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:03:29.967645 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:29.967184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:46967)
0807 05:03:29.967467 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:29.967527 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":86,"threads_started":1}
I20260807 05:03:30.116398 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:30.115924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:41299)
0807 05:03:30.116230 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:30.116290 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":74,"threads_started":1}
I20260807 05:03:30.309283 20517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:30.308874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:45071)
0807 05:03:30.309127 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:30.309182 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
I20260807 05:03:30.968906 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:30.968466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:33177)
0807 05:03:30.968742 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:30.968805 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
I20260807 05:03:31.117858 20519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:31.117291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:44953)
0807 05:03:31.117689 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:31.117756 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":84,"threads_started":1}
I20260807 05:03:31.310660 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:31.310134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:43041)
0807 05:03:31.310473 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:31.310558 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":76,"threads_started":1}
I20260807 05:03:31.970152 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:31.969691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:49605)
0807 05:03:31.969980 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:31.970041 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
I20260807 05:03:32.119307 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:32.118832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:58123)
0807 05:03:32.119121 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:32.119203 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":88,"threads_started":1}
I20260807 05:03:32.312115 20523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:32.311556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:40607)
0807 05:03:32.311881 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:32.311961 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":97,"threads_started":1}
I20260807 05:03:32.971446 20524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:32.970942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:44653)
0807 05:03:32.971256 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:32.971326 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":100,"threads_started":1}
I20260807 05:03:33.120709 20526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:33.120246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:54281)
0807 05:03:33.120530 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:33.120603 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":89,"threads_started":1}
I20260807 05:03:33.313370 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:33.312848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:46581)
0807 05:03:33.313200 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:33.313261 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":110,"threads_started":1}
I20260807 05:03:33.973058 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:33.972520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:42765)
0807 05:03:33.972831 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:33.972922 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":105,"threads_started":1}
I20260807 05:03:34.121927 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:34.121463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:60925)
0807 05:03:34.121754 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:34.121813 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260807 05:03:34.303534 20532 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:34.303689 20532 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:34.304206 20532 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
W20260807 05:03:34.305117 19909 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
W20260807 05:03:34.305254 19908 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:34.305356 19908 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8b780b571348ce8640e10adaa6bf21; no voters: 502be6dc279140cf92fd8b7c0ccda003, e725eb73124b4b42b2b1e6df2c713bb0
I20260807 05:03:34.305524 20532 raft_consensus.cc:2726] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:03:34.314602 20533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:34.314157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:49405)
0807 05:03:34.314430 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:34.314491 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":92,"threads_started":1}
I20260807 05:03:34.974244 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:34.973802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:47069)
0807 05:03:34.974048 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:34.974117 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":77,"threads_started":1}
I20260807 05:03:35.123029 20537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:35.122617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:52401)
0807 05:03:35.122883 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:35.122939 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":72,"threads_started":1}
I20260807 05:03:35.315728 20538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:35.315301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:49307)
0807 05:03:35.315575 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:35.315632 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":97,"threads_started":1}
I20260807 05:03:35.975579 20541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:35.975086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:32949)
0807 05:03:35.975377 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:35.975446 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":97,"threads_started":1}
I20260807 05:03:36.062228 20544 raft_consensus.cc:482] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:36.062356 20544 raft_consensus.cc:504] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e725eb73124b4b42b2b1e6df2c713bb0" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 39331 } } peers { permanent_uuid: "502be6dc279140cf92fd8b7c0ccda003" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 35083 } } peers { permanent_uuid: "9d8b780b571348ce8640e10adaa6bf21" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39629 } }
I20260807 05:03:36.062770 20544 leader_election.cc:288] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331), 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083)
W20260807 05:03:36.063484 19908 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 502be6dc279140cf92fd8b7c0ccda003 (127.25.214.194:35083): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
W20260807 05:03:36.063599 19909 leader_election.cc:341] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e725eb73124b4b42b2b1e6df2c713bb0 (127.25.214.195:39331): Not found: Tablet not found: e8f291bc403e44a798cdb6f604db0e86
I20260807 05:03:36.063663 19909 leader_election.cc:302] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8b780b571348ce8640e10adaa6bf21; no voters: 502be6dc279140cf92fd8b7c0ccda003, e725eb73124b4b42b2b1e6df2c713bb0
I20260807 05:03:36.063793 20544 raft_consensus.cc:2726] T e8f291bc403e44a798cdb6f604db0e86 P 9d8b780b571348ce8640e10adaa6bf21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 05:03:36.124512 20546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:36.123908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:52907)
0807 05:03:36.124335 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:36.124410 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":110,"threads_started":1}
I20260807 05:03:36.316967 20548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:36.316497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:43537)
0807 05:03:36.316808 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:36.316868 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":99,"threads_started":1}
I20260807 05:03:36.976908 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:36.976383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:48133)
0807 05:03:36.976693 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:36.976770 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":87,"threads_started":1}
I20260807 05:03:37.125789 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:37.125306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:33367)
0807 05:03:37.125593 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:37.125665 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":81,"threads_started":1}
I20260807 05:03:37.318127 20551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:37.317706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:57111)
0807 05:03:37.317969 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:37.318026 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":86,"threads_started":1}
I20260807 05:03:37.978188 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:37.977692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:35395)
0807 05:03:37.977990 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:37.978060 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":102,"threads_started":1}
I20260807 05:03:38.128105 20554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:38.126633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:39637)
0807 05:03:38.127877 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:38.127958 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1150,"thread_start_us":95,"threads_started":1}
I20260807 05:03:38.319489 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:38.318956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:56295)
0807 05:03:38.319253 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:38.319363 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
I20260807 05:03:38.979640 20557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:38.979240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.193:45283)
0807 05:03:38.979481 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:38.979540 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":81,"threads_started":1}
I20260807 05:03:39.129760 20558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:39.129300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.194:50719)
0807 05:03:39.129603 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:39.129659 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":96,"threads_started":1}
I20260807 05:03:39.304965 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 19835
I20260807 05:03:39.317195 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 20081
I20260807 05:03:39.325219 20560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:39.323612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:40621 (local address 127.25.214.195:59161)
0807 05:03:39.325061 (+ 1449us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:39.325122 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.254:40621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1359,"thread_start_us":993,"threads_started":1}
I20260807 05:03:39.330029 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 20290
2026-08-07T05:03:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59564 ms)
[----------] 30 tests from SecurityITest (245231 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:39 dist-test-slave-lgr5 krb5kdc[20568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:39 dist-test-slave-lgr5 krb5kdc[20568](info): set up 2 sockets
Aug 07 05:03:39 dist-test-slave-lgr5 krb5kdc[20568](info): commencing operation
krb5kdc: starting...
W20260807 05:03:40.510315 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:40 dist-test-slave-lgr5 krb5kdc[20568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:03:40.632929 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36043
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:40.743065 20586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:40.743371 20586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:40.743413 20586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:40.747386 20586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:40.747455 20586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:40.747473 20586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:40.747489 20586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:40.747502 20586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:40.752849 20586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:40.753919 20586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:40.754890 20586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:40.763523 20600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:40.763598 20586 server_base.cc:1034] running on GCE node
W20260807 05:03:40.763623 20597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:40.763523 20598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:40.764392 20586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:40.765401 20586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:40.766570 20586 hybrid_clock.cc:648] HybridClock initialized: now 1786079020766556 us; error 26 us; skew 500 ppm
Aug 07 05:03:40 dist-test-slave-lgr5 krb5kdc[20568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079020, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:40.769279 20586 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:03:40.770094 20586 webserver.cc:460] Webserver started at http://127.25.214.254:34355/ using document root <none> and password file <none>
I20260807 05:03:40.770617 20586 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:40.770684 20586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:40.770888 20586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:40.772941 20586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "abecce98eb7e49dc9eb9ad8f634217c0"
format_stamp: "Formatted at 2026-08-07 05:03:40 on dist-test-slave-lgr5"
server_key: "856993b6575f00c706988dcfb48b8413"
server_key_iv: "5f0e5acd4ed502d220ee7770586a5704"
server_key_version: "encryptionkey@0"
I20260807 05:03:40.773478 20586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "abecce98eb7e49dc9eb9ad8f634217c0"
format_stamp: "Formatted at 2026-08-07 05:03:40 on dist-test-slave-lgr5"
server_key: "856993b6575f00c706988dcfb48b8413"
server_key_iv: "5f0e5acd4ed502d220ee7770586a5704"
server_key_version: "encryptionkey@0"
I20260807 05:03:40.777024 20586 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:40.779311 20611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:40.780457 20586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:40.780581 20586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "abecce98eb7e49dc9eb9ad8f634217c0"
format_stamp: "Formatted at 2026-08-07 05:03:40 on dist-test-slave-lgr5"
server_key: "856993b6575f00c706988dcfb48b8413"
server_key_iv: "5f0e5acd4ed502d220ee7770586a5704"
server_key_version: "encryptionkey@0"
I20260807 05:03:40.780673 20586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:40.792433 20586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:40.795071 20586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:40.795236 20586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:40.801807 20586 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:36043
I20260807 05:03:40.801857 20680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:36043 every 8 connection(s)
I20260807 05:03:40.802690 20586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:40.805393 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:40.808998 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 20586
I20260807 05:03:40.809114 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:40.809369 26459 external_mini_cluster.cc:1428] Setting key af43b99c7d752aed2cb2a7e59ea1ae39
I20260807 05:03:40.810902 20681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0: Bootstrap starting.
I20260807 05:03:40.813496 20681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:40.814361 20681 log.cc:824] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:40.816277 20681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0: No bootstrap required, opened a new log
Aug 07 05:03:40 dist-test-slave-lgr5 krb5kdc[20568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:40.819974 20681 raft_consensus.cc:348] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36043 } }
I20260807 05:03:40.820252 20681 raft_consensus.cc:374] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:40.820320 20681 raft_consensus.cc:729] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abecce98eb7e49dc9eb9ad8f634217c0, State: Initialized, Role: FOLLOWER
I20260807 05:03:40.820777 20681 consensus_queue.cc:260] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36043 } }
I20260807 05:03:40.820930 20681 raft_consensus.cc:388] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:40.821004 20681 raft_consensus.cc:482] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:40.821098 20681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:40.821844 20681 raft_consensus.cc:504] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36043 } }
I20260807 05:03:40.822149 20681 leader_election.cc:302] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abecce98eb7e49dc9eb9ad8f634217c0; no voters:
I20260807 05:03:40.822414 20681 leader_election.cc:288] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:40.822502 20690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:40.822757 20690 raft_consensus.cc:686] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [term 1 LEADER]: Becoming Leader. State: Replica: abecce98eb7e49dc9eb9ad8f634217c0, State: Running, Role: LEADER
I20260807 05:03:40.823109 20690 consensus_queue.cc:237] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36043 } }
I20260807 05:03:40.823659 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:40.810686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55292 (local address 127.25.214.254:36043)
0807 05:03:40.811113 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:40.811133 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:40.811176 (+ 43us) server_negotiation.cc:407] Connection header received
0807 05:03:40.811962 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:40.811990 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:40.812421 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:40.812760 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:40.813479 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:40.814894 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:40.815757 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:40.816435 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:40.816610 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:40.818838 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:40.818844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:40.818860 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:40.818889 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:40.820781 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:40.821254 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:40.821260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:40.821264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:40.821376 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:40.821640 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:40.821643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:40.821645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:40.822049 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:40.822215 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:40.822555 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 05:03:40.822858 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":129,"threads_started":1}
I20260807 05:03:40.823825 20681 sys_catalog.cc:564] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:40.824250 20690 sys_catalog.cc:455] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36043 } } }
I20260807 05:03:40.824380 20690 sys_catalog.cc:458] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:40.825979 20696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:40.826588 20691 sys_catalog.cc:455] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abecce98eb7e49dc9eb9ad8f634217c0. Latest consensus state: current_term: 1 leader_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abecce98eb7e49dc9eb9ad8f634217c0" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36043 } } }
I20260807 05:03:40.826674 20691 sys_catalog.cc:458] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:40.828877 20696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:40.833977 20696 catalog_manager.cc:1347] Generated new cluster ID: 2ea2aa70071d4f5887a523106bcdd11f
I20260807 05:03:40.834035 20696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:40.842343 20696 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:40.843215 20696 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:40.847568 20696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0: Generated new TSK 0
I20260807 05:03:40.848172 20696 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:03:40.876034 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36043
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:40.989071 20721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:40.989323 20721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:40.989368 20721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:40.993310 20721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:40.993376 20721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:40.993438 20721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:40.998610 20721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:40.999643 20721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:41.000748 20721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:41.010653 20732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:41.010648 20729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:41.010794 20721 server_base.cc:1034] running on GCE node
W20260807 05:03:41.010644 20730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:41.011262 20721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:41.011884 20721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:41.013051 20721 hybrid_clock.cc:648] HybridClock initialized: now 1786079021013031 us; error 55 us; skew 500 ppm
Aug 07 05:03:41 dist-test-slave-lgr5 krb5kdc[20568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079021, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:41.015806 20721 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:03:41.016710 20721 webserver.cc:460] Webserver started at http://127.25.214.193:39903/ using document root <none> and password file <none>
I20260807 05:03:41.017248 20721 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:41.017314 20721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:41.017530 20721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:41.019555 20721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "c1f2da15d1b64dc7ba7416876f6f2225"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "41ab59aca4d49de4243d2eb59b33443b"
server_key_iv: "b128c14a09fe628430d1c388a9a7850a"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.020107 20721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "c1f2da15d1b64dc7ba7416876f6f2225"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "41ab59aca4d49de4243d2eb59b33443b"
server_key_iv: "b128c14a09fe628430d1c388a9a7850a"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.023849 20721 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:03:41.026616 20747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.027895 20721 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:41.028018 20721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "c1f2da15d1b64dc7ba7416876f6f2225"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "41ab59aca4d49de4243d2eb59b33443b"
server_key_iv: "b128c14a09fe628430d1c388a9a7850a"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.028167 20721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:41.082307 20721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:41.085700 20721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:41.085887 20721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:41.086490 20721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:41.087327 20721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:41.087374 20721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.087428 20721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:41.087462 20721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.096057 20721 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:39253
I20260807 05:03:41.096113 20913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:39253 every 8 connection(s)
I20260807 05:03:41.097064 20721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:41.103799 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 20721
I20260807 05:03:41.103920 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:03:41.104223 26459 external_mini_cluster.cc:1428] Setting key 6b8173868efeb7ce0e17049fb1196e11
Aug 07 05:03:41 dist-test-slave-lgr5 krb5kdc[20568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079021, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:41.110584 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.098991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:44547 (local address 127.25.214.254:36043)
0807 05:03:41.099131 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.099134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.099974 (+ 840us) server_negotiation.cc:407] Connection header received
0807 05:03:41.101316 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.101319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.101378 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.101453 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:41.102613 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.103194 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.104474 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.104702 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.104797 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.107285 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:41.107288 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:41.107290 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:41.107313 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:41.108689 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.109155 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.109158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.109160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.109234 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.109550 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.109554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.109556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.109743 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:41.109838 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.110299 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.110421 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 05:03:41.111351 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.099349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36043 (local address 127.25.214.193:44547)
0807 05:03:41.099817 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.099861 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.101103 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.101642 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.101649 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.101984 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:41.102463 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.102477 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.103318 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.103320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.104355 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.104365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.104870 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.104873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.105079 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.105726 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:41.105745 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:41.107129 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:41.108796 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:41.108802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:41.108816 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:41.109060 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:41.109316 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:41.109319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:41.109321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:41.109463 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:41.109845 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:41.109851 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:41.110079 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.110238 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.110553 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":106,"threads_started":1}
I20260807 05:03:41.112511 20914 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36043
I20260807 05:03:41.112728 20914 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:41.113184 20914 heartbeater.cc:511] Master 127.25.214.254:36043 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:03:41.114684 20634 ts_manager.cc:194] Registered new tserver with Master: c1f2da15d1b64dc7ba7416876f6f2225 (127.25.214.193:39253)
I20260807 05:03:41.115790 20634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:44547
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:03:41.130985 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36043
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:41.244254 20920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:41.244550 20920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:41.244596 20920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:41.248669 20920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:41.248741 20920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:41.248806 20920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:41.254333 20920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:41.255522 20920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:41.256647 20920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:41.266861 20925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:41.266942 20920 server_base.cc:1034] running on GCE node
W20260807 05:03:41.266880 20926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:41.266887 20929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:41.267612 20920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:41.268309 20920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:41.269464 20920 hybrid_clock.cc:648] HybridClock initialized: now 1786079021269438 us; error 40 us; skew 500 ppm
Aug 07 05:03:41 dist-test-slave-lgr5 krb5kdc[20568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079021, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:41.272325 20920 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:03:41.273391 20920 webserver.cc:460] Webserver started at http://127.25.214.194:43289/ using document root <none> and password file <none>
I20260807 05:03:41.273967 20920 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:41.274029 20920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:41.274206 20920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:41.276363 20920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "f441f7ece21d7f3266e7c9ba46a94c3b"
server_key_iv: "d575065ec6ea0a756c5314612ddfbba3"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.276896 20920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "f441f7ece21d7f3266e7c9ba46a94c3b"
server_key_iv: "d575065ec6ea0a756c5314612ddfbba3"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.280663 20920 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:03:41.283145 20945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.284515 20920 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:41.284633 20920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "f441f7ece21d7f3266e7c9ba46a94c3b"
server_key_iv: "d575065ec6ea0a756c5314612ddfbba3"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.284744 20920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:41.301879 20920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:41.304940 20920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:41.305155 20920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:41.305835 20920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:41.306802 20920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:41.306854 20920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.306912 20920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:41.306941 20920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.315935 20920 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:45629
I20260807 05:03:41.315958 21118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:45629 every 8 connection(s)
I20260807 05:03:41.316896 20920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:41.318436 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 20920
I20260807 05:03:41.318585 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:03:41.318980 26459 external_mini_cluster.cc:1428] Setting key de6bddc6c83755184ccde3906c836611
Aug 07 05:03:41 dist-test-slave-lgr5 krb5kdc[20568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079021, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:03:41.332031 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.318885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:52685 (local address 127.25.214.254:36043)
0807 05:03:41.319015 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.319018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.320215 (+ 1197us) server_negotiation.cc:407] Connection header received
0807 05:03:41.321625 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.321628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.321684 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.321766 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:41.323171 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.323871 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.325155 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.325382 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.325468 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.328448 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:41.328451 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:41.328453 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:41.328481 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:41.329948 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.330559 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.330562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.330563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.330650 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.330957 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.330959 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.330960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.331138 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:41.331221 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.331772 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.331899 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 05:03:41.332908 21124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.319446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36043 (local address 127.25.214.194:52685)
0807 05:03:41.320027 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.320108 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.321407 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.321930 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.321937 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.322291 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:41.322998 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.323019 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.323996 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.324000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.325035 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.325046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.325519 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.325524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.325698 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.326425 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:41.326442 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:41.328207 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:41.330071 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:41.330077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:41.330093 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:41.330441 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:41.330732 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:41.330735 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:41.330736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:41.330880 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:41.331243 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:41.331249 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:41.331530 (+ 281us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.331688 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.331975 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":155,"threads_started":1}
I20260807 05:03:41.334089 21120 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36043
I20260807 05:03:41.334373 21120 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:41.335000 21120 heartbeater.cc:511] Master 127.25.214.254:36043 requested a full tablet report, sending...
I20260807 05:03:41.336253 20634 ts_manager.cc:194] Registered new tserver with Master: cc5c1beaead34a0ab7d36c0dfdf2e9e3 (127.25.214.194:45629)
I20260807 05:03:41.337057 20634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:52685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:03:41.350651 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36043
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:41.466173 21129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:41.466442 21129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:41.466487 21129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:41.470571 21129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:41.470631 21129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:41.470692 21129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:41.476161 21129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:36043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:41.477240 21129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:41.478279 21129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:41.487615 21142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:41.487629 21146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:41.487660 21137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:41.488008 21129 server_base.cc:1034] running on GCE node
I20260807 05:03:41.488417 21129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:41.489040 21129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:41.490199 21129 hybrid_clock.cc:648] HybridClock initialized: now 1786079021490183 us; error 32 us; skew 500 ppm
Aug 07 05:03:41 dist-test-slave-lgr5 krb5kdc[20568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079021, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:41.492825 21129 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:03:41.493616 21129 webserver.cc:460] Webserver started at http://127.25.214.195:34391/ using document root <none> and password file <none>
I20260807 05:03:41.494138 21129 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:41.494204 21129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:41.494419 21129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:41.496491 21129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "ebca16bd5d5d46ab9bbd8da170239ce1"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "4fb6833c6d9e4f4f851eb46c3ae60cb0"
server_key_iv: "f29b0f39727d4fea3ab30d374f357aec"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.497023 21129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "ebca16bd5d5d46ab9bbd8da170239ce1"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "4fb6833c6d9e4f4f851eb46c3ae60cb0"
server_key_iv: "f29b0f39727d4fea3ab30d374f357aec"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.500583 21129 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:41.502956 21156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.504456 21129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:41.504555 21129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "ebca16bd5d5d46ab9bbd8da170239ce1"
format_stamp: "Formatted at 2026-08-07 05:03:41 on dist-test-slave-lgr5"
server_key: "4fb6833c6d9e4f4f851eb46c3ae60cb0"
server_key_iv: "f29b0f39727d4fea3ab30d374f357aec"
server_key_version: "encryptionkey@0"
I20260807 05:03:41.504659 21129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:41.526221 21129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:41.529188 21129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:41.529376 21129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:41.529949 21129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:41.530762 21129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:41.530813 21129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.530869 21129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:41.530895 21129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:41.539384 21129 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:38875
I20260807 05:03:41.539403 21323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:38875 every 8 connection(s)
I20260807 05:03:41.540273 21129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:41.548035 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 21129
I20260807 05:03:41.548195 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:03:41.548552 26459 external_mini_cluster.cc:1428] Setting key 659ca91647b46565af349e4610cc269a
Aug 07 05:03:41 dist-test-slave-lgr5 krb5kdc[20568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079021, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:41.553944 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.541978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:44857 (local address 127.25.214.254:36043)
0807 05:03:41.542120 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.542124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.542940 (+ 816us) server_negotiation.cc:407] Connection header received
0807 05:03:41.544258 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.544261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.544310 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.544393 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:41.545525 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.546073 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.547186 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.547392 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.547464 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.550299 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:41.550302 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:41.550306 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:41.550334 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:41.551719 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.552295 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.552298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.552299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.552400 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.552761 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.552763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.552764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.552971 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:41.553059 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.553621 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.553769 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 05:03:41.554914 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.542324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36043 (local address 127.25.214.195:44857)
0807 05:03:41.542779 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.542830 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.544015 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.544545 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.544551 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.544885 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:41.545368 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.545382 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.546186 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.546188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.547092 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.547101 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.547556 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.547560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.547710 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.548454 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:41.548471 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:41.550142 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:41.551836 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:41.551842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:41.551860 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:41.552192 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:41.552486 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:41.552490 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:41.552492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:41.552660 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:41.553077 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:41.553084 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:41.553362 (+ 278us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.553549 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.553932 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":122,"threads_started":1}
I20260807 05:03:41.556274 21325 heartbeater.cc:347] Connected to a master server at 127.25.214.254:36043
I20260807 05:03:41.556584 21325 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:41.557178 21325 heartbeater.cc:511] Master 127.25.214.254:36043 requested a full tablet report, sending...
I20260807 05:03:41.558379 20634 ts_manager.cc:194] Registered new tserver with Master: ebca16bd5d5d46ab9bbd8da170239ce1 (127.25.214.195:38875)
I20260807 05:03:41.558974 20634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:44857
I20260807 05:03:41.562402 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:41.571255 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.564361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55296 (local address 127.25.214.254:36043)
0807 05:03:41.564481 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.564486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.564712 (+ 226us) server_negotiation.cc:407] Connection header received
0807 05:03:41.564825 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.564828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.564872 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.564937 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:41.565712 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.566217 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.567028 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.567243 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.567328 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.568608 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:41.568612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:41.568614 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:41.568637 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:41.569715 (+ 1078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.570098 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.570102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.570104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.570176 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:41.570417 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:41.570421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:41.570423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:41.570642 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:41.570764 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.570995 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.571105 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:03:41.573892 20634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:41.576905 20634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:41.591249 21346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.585947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54620 (local address 127.25.214.194:45629)
0807 05:03:41.586341 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.586358 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.586846 (+ 488us) server_negotiation.cc:407] Connection header received
0807 05:03:41.586942 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.586948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.587117 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.587246 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:41.587459 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.588514 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.589921 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.590536 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.590658 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.590813 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.590985 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.591087 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":101,"threads_started":1}
I20260807 05:03:41.591249 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.585285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:45629 (local address 127.0.0.1:54620)
0807 05:03:41.586503 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.586517 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.586641 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.587238 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.587241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.587259 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:41.587371 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.587379 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.588670 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.588673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.589787 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.589798 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.590663 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.590667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.590784 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.590823 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.590940 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.591079 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"mutex_wait_us":3,"spinlock_wait_cycles":7680,"thread_start_us":92,"threads_started":1}
I20260807 05:03:41.591461 21339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.585146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39253 (local address 127.0.0.1:44594)
0807 05:03:41.585626 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.585673 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.585809 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.586573 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.586579 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.586623 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:41.586779 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.586788 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.588138 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.588142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.589645 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.589658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.591016 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.591020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.591127 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.591151 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.591223 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.591298 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":29,"spinlock_wait_cycles":6016,"thread_start_us":71,"threads_started":1}
I20260807 05:03:41.591893 21344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.585284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44594 (local address 127.25.214.193:39253)
0807 05:03:41.585875 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.585892 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.585917 (+ 25us) server_negotiation.cc:407] Connection header received
0807 05:03:41.585997 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.586002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.586222 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.586375 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:41.586916 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.587971 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.589805 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.590699 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.590817 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.590945 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.591650 (+ 705us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.591753 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":138,"threads_started":1}
I20260807 05:03:41.591900 21341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.585743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:38875 (local address 127.0.0.1:38284)
0807 05:03:41.586834 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.586847 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.586942 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.587493 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.587496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.587513 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:41.587601 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.587607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.589007 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.589010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.590250 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.590261 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.591526 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.591529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.591631 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.591653 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.591719 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.591778 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1032,"mutex_wait_us":38,"thread_start_us":97,"threads_started":1}
I20260807 05:03:41.592470 21350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.586151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38284 (local address 127.25.214.195:38875)
0807 05:03:41.586745 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.586756 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.586932 (+ 176us) server_negotiation.cc:407] Connection header received
0807 05:03:41.587043 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.587049 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.587234 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.587376 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:41.587715 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.588681 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.590395 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.591235 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.591340 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.591458 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.592208 (+ 750us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.592333 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":93,"threads_started":1}
I20260807 05:03:41.595080 21221 tablet_service.cc:1467] Processing CreateTablet for tablet e0055b70114743d19414b9a32ec83693 (DEFAULT_TABLE table=test-table [id=007a43185cc7408c90798cedf08ca338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:41.595080 21018 tablet_service.cc:1467] Processing CreateTablet for tablet e0055b70114743d19414b9a32ec83693 (DEFAULT_TABLE table=test-table [id=007a43185cc7408c90798cedf08ca338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:41.596295 21018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0055b70114743d19414b9a32ec83693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:41.596295 21221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0055b70114743d19414b9a32ec83693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:41.597790 20814 tablet_service.cc:1467] Processing CreateTablet for tablet e0055b70114743d19414b9a32ec83693 (DEFAULT_TABLE table=test-table [id=007a43185cc7408c90798cedf08ca338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:41.598870 20814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0055b70114743d19414b9a32ec83693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:41.606953 21356 tablet_bootstrap.cc:492] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Bootstrap starting.
I20260807 05:03:41.607859 21353 tablet_bootstrap.cc:492] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Bootstrap starting.
I20260807 05:03:41.609699 21356 tablet_bootstrap.cc:654] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:41.609702 21354 tablet_bootstrap.cc:492] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: Bootstrap starting.
I20260807 05:03:41.609889 21353 tablet_bootstrap.cc:654] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:41.611191 21353 log.cc:824] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:41.611191 21356 log.cc:824] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:41.611505 21354 tablet_bootstrap.cc:654] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:41.612600 21354 log.cc:824] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:41.613237 21356 tablet_bootstrap.cc:492] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: No bootstrap required, opened a new log
I20260807 05:03:41.613451 21356 ts_tablet_manager.cc:1397] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 05:03:41.613502 21353 tablet_bootstrap.cc:492] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: No bootstrap required, opened a new log
I20260807 05:03:41.613672 21353 ts_tablet_manager.cc:1397] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:03:41.614436 21354 tablet_bootstrap.cc:492] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: No bootstrap required, opened a new log
I20260807 05:03:41.614606 21354 ts_tablet_manager.cc:1397] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:03:41.616655 21356 raft_consensus.cc:348] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.616881 21356 raft_consensus.cc:374] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:41.616935 21356 raft_consensus.cc:729] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5c1beaead34a0ab7d36c0dfdf2e9e3, State: Initialized, Role: FOLLOWER
I20260807 05:03:41.617344 21356 consensus_queue.cc:260] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.617434 21353 raft_consensus.cc:348] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.617686 21353 raft_consensus.cc:374] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:41.617741 21353 raft_consensus.cc:729] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebca16bd5d5d46ab9bbd8da170239ce1, State: Initialized, Role: FOLLOWER
I20260807 05:03:41.618119 21120 heartbeater.cc:503] Master 127.25.214.254:36043 was elected leader, sending a full tablet report...
I20260807 05:03:41.618177 21353 consensus_queue.cc:260] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.618137 21354 raft_consensus.cc:348] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.618381 21354 raft_consensus.cc:374] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:41.618449 21354 raft_consensus.cc:729] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f2da15d1b64dc7ba7416876f6f2225, State: Initialized, Role: FOLLOWER
I20260807 05:03:41.618835 21354 consensus_queue.cc:260] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.619114 21353 ts_tablet_manager.cc:1428] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 05:03:41.619451 21325 heartbeater.cc:503] Master 127.25.214.254:36043 was elected leader, sending a full tablet report...
I20260807 05:03:41.619680 21354 ts_tablet_manager.cc:1428] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 05:03:41.619968 20914 heartbeater.cc:503] Master 127.25.214.254:36043 was elected leader, sending a full tablet report...
I20260807 05:03:41.620234 21356 ts_tablet_manager.cc:1428] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260807 05:03:41.791397 21327 tablet.cc:2369] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:03:41.818097 21122 tablet.cc:2369] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 05:03:41.854527 20915 tablet.cc:2369] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:03:41.951117 21361 raft_consensus.cc:482] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:41.951383 21361 raft_consensus.cc:504] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.952627 21361 leader_election.cc:288] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1f2da15d1b64dc7ba7416876f6f2225 (127.25.214.193:39253), ebca16bd5d5d46ab9bbd8da170239ce1 (127.25.214.195:38875)
I20260807 05:03:41.957942 21350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.953444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:35311 (local address 127.25.214.195:38875)
0807 05:03:41.953565 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.953568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.953582 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:03:41.953638 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.953640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.953692 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.953759 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:41.954003 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.954807 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.956519 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.957128 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.957255 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.957312 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.957731 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.957807 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:03:41.957942 21344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.953006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:40559 (local address 127.25.214.193:39253)
0807 05:03:41.953315 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:41.953320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:41.953338 (+ 18us) server_negotiation.cc:407] Connection header received
0807 05:03:41.953502 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:41.953506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:41.953560 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:41.953609 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:41.954018 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.954793 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.956519 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.957144 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.957255 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.957312 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:41.957731 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 05:03:41.957807 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260807 05:03:41.958009 21364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.952914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:38875 (local address 127.25.214.194:35311)
0807 05:03:41.953215 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.953226 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.953349 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.953792 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.953795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.953808 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:41.953904 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.953910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.954911 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.954914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.956373 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.956385 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.957294 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.957299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.957550 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.957596 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.957686 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.957800 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":173,"spinlock_wait_cycles":14208,"thread_start_us":74,"threads_started":1}
I20260807 05:03:41.958225 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:41.952885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39253 (local address 127.25.214.194:40559)
0807 05:03:41.953196 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:41.953212 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:41.953348 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:41.953739 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:41.953742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:41.953762 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:41.953897 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.953904 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.954911 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.954914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.956373 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:41.956385 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:41.957294 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:41.957299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:41.957520 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:41.957601 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 05:03:41.957686 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:03:41.957800 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":166,"spinlock_wait_cycles":23168,"thread_start_us":113,"threads_started":1}
I20260807 05:03:41.958775 21254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0055b70114743d19414b9a32ec83693" candidate_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" is_pre_election: true
I20260807 05:03:41.958894 20843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0055b70114743d19414b9a32ec83693" candidate_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" is_pre_election: true
I20260807 05:03:41.959089 21254 raft_consensus.cc:2454] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5c1beaead34a0ab7d36c0dfdf2e9e3 in term 0.
I20260807 05:03:41.959187 20843 raft_consensus.cc:2454] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5c1beaead34a0ab7d36c0dfdf2e9e3 in term 0.
I20260807 05:03:41.959601 20952 leader_election.cc:302] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5c1beaead34a0ab7d36c0dfdf2e9e3, ebca16bd5d5d46ab9bbd8da170239ce1; no voters:
I20260807 05:03:41.959892 21361 raft_consensus.cc:2781] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:41.959986 21361 raft_consensus.cc:482] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:41.960042 21361 raft_consensus.cc:3037] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:41.961318 21361 raft_consensus.cc:504] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.961709 21361 leader_election.cc:288] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [CANDIDATE]: Term 1 election: Requested vote from peers c1f2da15d1b64dc7ba7416876f6f2225 (127.25.214.193:39253), ebca16bd5d5d46ab9bbd8da170239ce1 (127.25.214.195:38875)
I20260807 05:03:41.962116 21254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0055b70114743d19414b9a32ec83693" candidate_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1"
I20260807 05:03:41.962118 20843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0055b70114743d19414b9a32ec83693" candidate_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f2da15d1b64dc7ba7416876f6f2225"
I20260807 05:03:41.962236 21254 raft_consensus.cc:3037] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:41.962229 20843 raft_consensus.cc:3037] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:41.963441 20843 raft_consensus.cc:2454] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5c1beaead34a0ab7d36c0dfdf2e9e3 in term 1.
I20260807 05:03:41.963579 21254 raft_consensus.cc:2454] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5c1beaead34a0ab7d36c0dfdf2e9e3 in term 1.
I20260807 05:03:41.963838 20949 leader_election.cc:302] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1f2da15d1b64dc7ba7416876f6f2225, cc5c1beaead34a0ab7d36c0dfdf2e9e3; no voters:
I20260807 05:03:41.964030 21361 raft_consensus.cc:2781] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:41.964305 21361 raft_consensus.cc:686] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 1 LEADER]: Becoming Leader. State: Replica: cc5c1beaead34a0ab7d36c0dfdf2e9e3, State: Running, Role: LEADER
I20260807 05:03:41.964666 21361 consensus_queue.cc:237] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } }
I20260807 05:03:41.968029 20632 catalog_manager.cc:5495] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc5c1beaead34a0ab7d36c0dfdf2e9e3 (127.25.214.194). New cstate: current_term: 1 leader_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc5c1beaead34a0ab7d36c0dfdf2e9e3" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260807 05:03:42.050613 21346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.046913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54632 (local address 127.25.214.194:45629)
0807 05:03:42.047074 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:42.047079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:42.047094 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:03:42.047181 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:42.047183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:42.047241 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:42.047341 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:42.047613 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.048156 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.049054 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.049275 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.049375 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.049707 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:42.050188 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:42.050304 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:42.050388 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 05:03:42.050457 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 05:03:42.057730 21254 raft_consensus.cc:1261] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 1 FOLLOWER]: Refusing update from remote peer cc5c1beaead34a0ab7d36c0dfdf2e9e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:42.057730 20843 raft_consensus.cc:1261] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 1 FOLLOWER]: Refusing update from remote peer cc5c1beaead34a0ab7d36c0dfdf2e9e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:42.058645 21361 consensus_queue.cc:1035] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebca16bd5d5d46ab9bbd8da170239ce1" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:42.058876 21368 consensus_queue.cc:1035] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f2da15d1b64dc7ba7416876f6f2225" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:42.069665 21373 mvcc.cc:205] Tried to move back new op lower bound from 7315779674339266560 to 7315779673969897472. Current Snapshot: MvccSnapshot[applied={T|T < 7315779674339266560}]
I20260807 05:03:42.075353 20628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:42.075518 20628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:42.078020 20628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abecce98eb7e49dc9eb9ad8f634217c0: Sending DeleteTablet for 3 replicas of tablet e0055b70114743d19414b9a32ec83693
I20260807 05:03:42.078845 20814 tablet_service.cc:1514] Processing DeleteTablet for tablet e0055b70114743d19414b9a32ec83693 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:44594
I20260807 05:03:42.078845 21018 tablet_service.cc:1514] Processing DeleteTablet for tablet e0055b70114743d19414b9a32ec83693 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:54620
I20260807 05:03:42.079360 21221 tablet_service.cc:1514] Processing DeleteTablet for tablet e0055b70114743d19414b9a32ec83693 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:42 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:38284
I20260807 05:03:42.079401 21387 tablet_replica.cc:330] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225: stopping tablet replica
I20260807 05:03:42.079769 21387 raft_consensus.cc:2229] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:42.079811 21389 tablet_replica.cc:330] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: stopping tablet replica
I20260807 05:03:42.080163 21387 raft_consensus.cc:2258] T e0055b70114743d19414b9a32ec83693 P c1f2da15d1b64dc7ba7416876f6f2225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:42.080305 21389 raft_consensus.cc:2229] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:42.080572 21388 tablet_replica.cc:330] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: stopping tablet replica
I20260807 05:03:42.080708 21389 raft_consensus.cc:2258] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:42.080843 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 20721
I20260807 05:03:42.080847 21388 raft_consensus.cc:2229] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:03:42.081192 21388 raft_consensus.cc:2258] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:42.084980 21388 ts_tablet_manager.cc:1905] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:42.087941 21388 ts_tablet_manager.cc:1918] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:42.088052 21388 log.cc:1196] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/e0055b70114743d19414b9a32ec83693
I20260807 05:03:42.088378 21388 ts_tablet_manager.cc:1939] T e0055b70114743d19414b9a32ec83693 P cc5c1beaead34a0ab7d36c0dfdf2e9e3: Deleting consensus metadata
I20260807 05:03:42.089723 20612 catalog_manager.cc:4841] TS cc5c1beaead34a0ab7d36c0dfdf2e9e3 (127.25.214.194:45629): tablet e0055b70114743d19414b9a32ec83693 (table test-table [id=007a43185cc7408c90798cedf08ca338]) successfully deleted
I20260807 05:03:42.093405 21389 ts_tablet_manager.cc:1905] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 05:03:42.094201 20615 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:39253 (error 108)
I20260807 05:03:42.095364 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.094940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:39253 (local address 127.0.0.1:44602)
0807 05:03:42.095180 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:42.095258 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":74,"threads_started":1}
I20260807 05:03:42.095472 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 20920
I20260807 05:03:42.096374 21389 ts_tablet_manager.cc:1918] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:42.096501 21389 log.cc:1196] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/e0055b70114743d19414b9a32ec83693
I20260807 05:03:42.096865 21389 ts_tablet_manager.cc:1939] T e0055b70114743d19414b9a32ec83693 P ebca16bd5d5d46ab9bbd8da170239ce1: Deleting consensus metadata
I20260807 05:03:42.100142 20616 catalog_manager.cc:4841] TS ebca16bd5d5d46ab9bbd8da170239ce1 (127.25.214.195:38875): tablet e0055b70114743d19414b9a32ec83693 (table test-table [id=007a43185cc7408c90798cedf08ca338]) successfully deleted
W20260807 05:03:42.109617 20615 catalog_manager.cc:4584] TS c1f2da15d1b64dc7ba7416876f6f2225 (127.25.214.193:39253): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e0055b70114743d19414b9a32ec83693: Network error: Client connection negotiation failed: client connection to 127.25.214.193:39253: connect: Connection refused (error 111)
I20260807 05:03:42.117843 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 21129
I20260807 05:03:42.129946 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 20586
2026-08-07T05:03:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2802 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T05:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:42Z Disabled control of system clock
I20260807 05:03:42.176196 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42351
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:42351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 05:03:42.293107 21399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:42.293416 21399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:42.293455 21399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:42.297502 21399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:42.297577 21399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:42.297595 21399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:42.297614 21399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:42.297631 21399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:42.302606 21399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:42351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:42.303794 21399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:42.305231 21399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:42.313750 21412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:42.313774 21406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.313854 21399 server_base.cc:1034] running on GCE node
W20260807 05:03:42.313771 21407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.314615 21399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:42.315719 21399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:42.316886 21399 hybrid_clock.cc:648] HybridClock initialized: now 1786079022316854 us; error 41 us; skew 500 ppm
I20260807 05:03:42.322212 21399 webserver.cc:460] Webserver started at http://127.25.214.254:43809/ using document root <none> and password file <none>
I20260807 05:03:42.322870 21399 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:42.322944 21399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:42.323190 21399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:42.325445 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "8104b401aea545b0af90441f6db49357"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "8ea9492c642889d609baa96e1443eed7"
server_key_iv: "8413bd2223ad667e42a9b8118860ad74"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.326030 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "8104b401aea545b0af90441f6db49357"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "8ea9492c642889d609baa96e1443eed7"
server_key_iv: "8413bd2223ad667e42a9b8118860ad74"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.329840 21399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:03:42.332355 21424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.333632 21399 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:03:42.333761 21399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "8104b401aea545b0af90441f6db49357"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "8ea9492c642889d609baa96e1443eed7"
server_key_iv: "8413bd2223ad667e42a9b8118860ad74"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.333865 21399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:42.357151 21399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:42.357923 21399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:42.358121 21399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:42.366791 21399 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:42351
I20260807 05:03:42.366811 21502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:42351 every 8 connection(s)
I20260807 05:03:42.367774 21399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:42.370777 21503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:42.373842 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 21399
I20260807 05:03:42.373965 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:42.374226 26459 external_mini_cluster.cc:1428] Setting key a48363064e02a3fc239083443e69c4fd
I20260807 05:03:42.376461 21503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357: Bootstrap starting.
I20260807 05:03:42.378701 21503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:42.379549 21503 log.cc:824] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:42.381488 21503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357: No bootstrap required, opened a new log
I20260807 05:03:42.383080 21507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.375586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.25.214.254:42351)
0807 05:03:42.376213 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:42.376229 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:42.376266 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:03:42.376919 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:42.376937 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:42.377315 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:42.377584 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:42.377914 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.378883 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.380001 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.380504 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.380670 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.381463 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:42.381468 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:42.381480 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:42.381874 (+ 394us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:42.381926 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:42.381947 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:42.382030 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:42.382173 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 05:03:42.382416 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":111,"threads_started":1}
I20260807 05:03:42.385190 21503 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8104b401aea545b0af90441f6db49357" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42351 } }
I20260807 05:03:42.385452 21503 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:42.385519 21503 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8104b401aea545b0af90441f6db49357, State: Initialized, Role: FOLLOWER
I20260807 05:03:42.385921 21503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8104b401aea545b0af90441f6db49357" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42351 } }
I20260807 05:03:42.386055 21503 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:42.386117 21503 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:42.386211 21503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:42.387053 21503 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8104b401aea545b0af90441f6db49357" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42351 } }
I20260807 05:03:42.387356 21503 leader_election.cc:302] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8104b401aea545b0af90441f6db49357; no voters:
I20260807 05:03:42.387631 21503 leader_election.cc:288] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:42.387724 21510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:42.387953 21510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [term 1 LEADER]: Becoming Leader. State: Replica: 8104b401aea545b0af90441f6db49357, State: Running, Role: LEADER
I20260807 05:03:42.388253 21510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8104b401aea545b0af90441f6db49357" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42351 } }
I20260807 05:03:42.388773 21503 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:42.389617 21511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8104b401aea545b0af90441f6db49357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8104b401aea545b0af90441f6db49357" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42351 } } }
I20260807 05:03:42.389753 21511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:42.390116 21523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:42.390239 21512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8104b401aea545b0af90441f6db49357. Latest consensus state: current_term: 1 leader_uuid: "8104b401aea545b0af90441f6db49357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8104b401aea545b0af90441f6db49357" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42351 } } }
I20260807 05:03:42.390350 21512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:42.392724 21523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:42.397555 21523 catalog_manager.cc:1347] Generated new cluster ID: 15eb7579cb1246788e60edfa35b45fde
I20260807 05:03:42.397619 21523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:42.419482 21523 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:42.420485 21523 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:42.433693 21523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357: Generated new TSK 0
I20260807 05:03:42.434465 21523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:42.447206 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42351
--builtin_ntp_servers=127.25.214.212:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 05:03:42.560948 21539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:42.561208 21539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:42.561249 21539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:42.565255 21539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:42.565312 21539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:42.565366 21539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:42.570147 21539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:42.571306 21539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:42.572770 21539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:42.582497 21547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:42.582497 21546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:42.582561 21551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.582701 21539 server_base.cc:1034] running on GCE node
I20260807 05:03:42.583237 21539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:42.583956 21539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:42.585103 21539 hybrid_clock.cc:648] HybridClock initialized: now 1786079022585079 us; error 49 us; skew 500 ppm
I20260807 05:03:42.586964 21539 webserver.cc:460] Webserver started at http://127.25.214.193:34543/ using document root <none> and password file <none>
I20260807 05:03:42.587541 21539 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:42.587610 21539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:42.587815 21539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:42.589965 21539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "62d118cd75964a5a93c9730773c7c6e5"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "56a1e6b7baca4d4bdb2d10085bb55c2f"
server_key_iv: "d491c3997279f67f077517beb211756a"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.590543 21539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "62d118cd75964a5a93c9730773c7c6e5"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "56a1e6b7baca4d4bdb2d10085bb55c2f"
server_key_iv: "d491c3997279f67f077517beb211756a"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.594120 21539 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 05:03:42.596606 21560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.597839 21539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:42.597961 21539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "62d118cd75964a5a93c9730773c7c6e5"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "56a1e6b7baca4d4bdb2d10085bb55c2f"
server_key_iv: "d491c3997279f67f077517beb211756a"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.598065 21539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:42.609228 21539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:42.609833 21539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:42.609994 21539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:42.610553 21539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:42.611418 21539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:42.611472 21539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.611522 21539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:42.611552 21539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.619923 21539 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:46567
I20260807 05:03:42.619946 21742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:46567 every 8 connection(s)
I20260807 05:03:42.620836 21539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:42.623885 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 21539
I20260807 05:03:42.623994 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:03:42.624313 26459 external_mini_cluster.cc:1428] Setting key 7c8bcc9d90e06761f1073a22719f7605
I20260807 05:03:42.626431 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42351
--builtin_ntp_servers=127.25.214.212:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 05:03:42.630617 21507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.622556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:46455 (local address 127.25.214.254:42351)
0807 05:03:42.622677 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:42.622680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:42.623708 (+ 1028us) server_negotiation.cc:407] Connection header received
0807 05:03:42.625208 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:42.625211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:42.625264 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:42.625339 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:42.626484 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.627098 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.628638 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.628866 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.628969 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.630116 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:42.630120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:42.630122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:42.630139 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:42.630160 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:42.630168 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:42.630229 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:42.630381 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 05:03:42.630453 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 05:03:42.631721 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.622901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42351 (local address 127.25.214.193:46455)
0807 05:03:42.623540 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:42.623581 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:42.625003 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:42.625541 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:42.625551 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:42.625657 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:42.626315 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:42.626336 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.627236 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.627240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:42.628513 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:42.628524 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.629024 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.629028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:42.629196 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.629829 (+ 633us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:42.629830 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:42.629876 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:42.629953 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:42.630241 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:42.630251 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:42.630257 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:03:42.630376 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 05:03:42.630748 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":107,"threads_started":1}
I20260807 05:03:42.633205 21743 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42351
I20260807 05:03:42.633468 21743 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:42.634081 21743 heartbeater.cc:511] Master 127.25.214.254:42351 requested a full tablet report, sending...
I20260807 05:03:42.635943 21450 ts_manager.cc:194] Registered new tserver with Master: 62d118cd75964a5a93c9730773c7c6e5 (127.25.214.193:46567)
I20260807 05:03:42.637742 21450 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.193:46455
W20260807 05:03:42.740006 21746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:42.740315 21746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:42.740355 21746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:42.744282 21746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:42.744326 21746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:42.744377 21746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:42.748941 21746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:42.749891 21746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:42.751189 21746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:42.760290 21760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:42.760291 21757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.760385 21746 server_base.cc:1034] running on GCE node
W20260807 05:03:42.760568 21758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.761039 21746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:42.761607 21746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:42.762761 21746 hybrid_clock.cc:648] HybridClock initialized: now 1786079022762743 us; error 30 us; skew 500 ppm
I20260807 05:03:42.764516 21746 webserver.cc:460] Webserver started at http://127.25.214.194:35443/ using document root <none> and password file <none>
I20260807 05:03:42.765048 21746 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:42.765112 21746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:42.765317 21746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:42.767288 21746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "cbc582d7f06f46c1b0dfd888dbda12c5"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "a63784f9e6e0e20abff38d9da5e8da5a"
server_key_iv: "2f951e7921fb0b79de48634f9e7142c4"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.767817 21746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "cbc582d7f06f46c1b0dfd888dbda12c5"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "a63784f9e6e0e20abff38d9da5e8da5a"
server_key_iv: "2f951e7921fb0b79de48634f9e7142c4"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.771291 21746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 05:03:42.773592 21768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.774712 21746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:03:42.774806 21746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "cbc582d7f06f46c1b0dfd888dbda12c5"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "a63784f9e6e0e20abff38d9da5e8da5a"
server_key_iv: "2f951e7921fb0b79de48634f9e7142c4"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.774906 21746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:42.785730 21746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:42.786392 21746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:42.786574 21746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:42.787180 21746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:42.788247 21746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:42.788311 21746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.788367 21746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:42.788394 21746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.797081 21746 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:36185
I20260807 05:03:42.797127 21948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:36185 every 8 connection(s)
I20260807 05:03:42.797984 21746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:42.803685 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 21746
I20260807 05:03:42.803800 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:03:42.804118 26459 external_mini_cluster.cc:1428] Setting key 8c1daed3cccac82095d9a7b78fc2f070
I20260807 05:03:42.805989 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42351
--builtin_ntp_servers=127.25.214.212:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 05:03:42.807153 21507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.799767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:35393 (local address 127.25.214.254:42351)
0807 05:03:42.799911 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:42.799915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:42.800988 (+ 1073us) server_negotiation.cc:407] Connection header received
0807 05:03:42.802446 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:42.802450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:42.802510 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:42.802582 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:42.803486 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.804068 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.805323 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.805542 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.805627 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.806692 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:42.806696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:42.806699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:42.806712 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:42.806730 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:42.806737 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:42.806796 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:42.806951 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 05:03:42.807012 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 05:03:42.808141 21951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.800128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42351 (local address 127.25.214.194:35393)
0807 05:03:42.800842 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:42.800886 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:42.802225 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:42.802758 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:42.802765 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:42.802848 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:42.803317 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:42.803329 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.804219 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.804222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:42.805196 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:42.805207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.805678 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.805682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:42.805835 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.806446 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:42.806447 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:42.806486 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:42.806546 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:42.806809 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:42.806819 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:42.806825 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:03:42.806935 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 05:03:42.807199 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
I20260807 05:03:42.809213 21949 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42351
I20260807 05:03:42.809432 21949 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:42.809912 21949 heartbeater.cc:511] Master 127.25.214.254:42351 requested a full tablet report, sending...
I20260807 05:03:42.810916 21450 ts_manager.cc:194] Registered new tserver with Master: cbc582d7f06f46c1b0dfd888dbda12c5 (127.25.214.194:36185)
I20260807 05:03:42.811463 21450 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.194:35393
W20260807 05:03:42.917157 21952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:42.917385 21952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:42.917435 21952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:42.921286 21952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:42.921331 21952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:42.921401 21952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:42.925984 21952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:42351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:42.926975 21952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:42.928365 21952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:42.937582 21958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:42.937568 21961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.937726 21952 server_base.cc:1034] running on GCE node
W20260807 05:03:42.937556 21963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:42.938239 21952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:42.938879 21952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:42.940059 21952 hybrid_clock.cc:648] HybridClock initialized: now 1786079022940034 us; error 40 us; skew 500 ppm
I20260807 05:03:42.941951 21952 webserver.cc:460] Webserver started at http://127.25.214.195:39139/ using document root <none> and password file <none>
I20260807 05:03:42.942512 21952 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:42.942579 21952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:42.942782 21952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:42.944881 21952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "642d0794fe21466aa854861d197eb238"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "7071442e0bdb92479d6d5527ed9086a7"
server_key_iv: "a2982c7503e9272a00ff9f2e266ff8d7"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.945428 21952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "642d0794fe21466aa854861d197eb238"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "7071442e0bdb92479d6d5527ed9086a7"
server_key_iv: "a2982c7503e9272a00ff9f2e266ff8d7"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.949397 21952 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 05:03:42.952047 21970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.953409 21952 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:03:42.953549 21952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "642d0794fe21466aa854861d197eb238"
format_stamp: "Formatted at 2026-08-07 05:03:42 on dist-test-slave-lgr5"
server_key: "7071442e0bdb92479d6d5527ed9086a7"
server_key_iv: "a2982c7503e9272a00ff9f2e266ff8d7"
server_key_version: "encryptionkey@0"
I20260807 05:03:42.953663 21952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:42.970922 21952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:42.971698 21952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:42.971881 21952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:42.972548 21952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:42.973531 21952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:42.973579 21952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.973634 21952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:42.973660 21952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:42.982699 21952 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:40707
I20260807 05:03:42.982752 22156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:40707 every 8 connection(s)
I20260807 05:03:42.983623 21952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:42.992626 21507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.985406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:50793 (local address 127.25.214.254:42351)
0807 05:03:42.985571 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:42.985575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:42.986634 (+ 1059us) server_negotiation.cc:407] Connection header received
0807 05:03:42.988008 (+ 1374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:42.988011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:42.988063 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:42.988176 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:42.989100 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.989687 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.990881 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.991149 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.991231 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.992240 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:42.992244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:42.992246 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:42.992259 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:42.992278 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:42.992286 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:42.992337 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:42.992449 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 05:03:42.992499 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 05:03:42.993251 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 21952
I20260807 05:03:42.993379 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:03:42.993647 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:42.985802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:42351 (local address 127.25.214.195:50793)
0807 05:03:42.986494 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:42.986535 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:42.987778 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:42.988344 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:42.988352 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:42.988437 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:42.988963 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:42.988979 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.989813 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.989817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:42.990755 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:42.990766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:42.991282 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:42.991285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:42.991429 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:42.991969 (+ 540us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:42.991970 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:42.992009 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:42.992072 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:42.992344 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:42.992349 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:42.992353 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 05:03:42.992443 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 05:03:42.992658 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":121,"threads_started":1}
I20260807 05:03:42.993685 26459 external_mini_cluster.cc:1428] Setting key 5a5b6e0421f1b86db7477f0dc7baac8d
I20260807 05:03:42.994863 22158 heartbeater.cc:347] Connected to a master server at 127.25.214.254:42351
I20260807 05:03:42.995124 22158 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:42.995710 22158 heartbeater.cc:511] Master 127.25.214.254:42351 requested a full tablet report, sending...
I20260807 05:03:42.996727 21449 ts_manager.cc:194] Registered new tserver with Master: 642d0794fe21466aa854861d197eb238 (127.25.214.195:40707)
I20260807 05:03:42.997295 21449 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.195:50793
I20260807 05:03:43.007432 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:43.012934 21507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.009383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56378 (local address 127.25.214.254:42351)
0807 05:03:43.009498 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.009502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.009662 (+ 160us) server_negotiation.cc:407] Connection header received
0807 05:03:43.009762 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.009764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.009803 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.009868 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:43.010076 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.010585 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.011454 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.011674 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.011756 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.012502 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:43.012506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:43.012508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:43.012529 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:43.012548 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:43.012556 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:43.012628 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.012765 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.012816 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:03:43.015892 21449 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:43.018887 21449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:43.032822 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.027461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36185 (local address 127.0.0.1:58418)
0807 05:03:43.028320 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:43.028333 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:43.028424 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:43.028906 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:43.028909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:43.028928 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:43.029031 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.029038 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.030017 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.030021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.031304 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.031314 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.032244 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.032248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.032356 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.032413 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 05:03:43.032529 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 05:03:43.032658 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"mutex_wait_us":91,"thread_start_us":95,"threads_started":1}
I20260807 05:03:43.032866 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.027847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58418 (local address 127.25.214.194:36185)
0807 05:03:43.028367 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.028379 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.028404 (+ 25us) server_negotiation.cc:407] Connection header received
0807 05:03:43.028629 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.028633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.028773 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.028918 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:43.029131 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.029902 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.031422 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.032112 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.032226 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.032412 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.032590 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.032697 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":104,"threads_started":1}
I20260807 05:03:43.033318 22182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.026751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:40707 (local address 127.0.0.1:60364)
0807 05:03:43.027474 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:43.027526 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:43.027655 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:43.028579 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:43.028585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:43.028623 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:43.028799 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.028807 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.030437 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.030441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.031675 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.031686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.032911 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.032914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.033010 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.033035 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:03:43.033106 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 05:03:43.033177 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":75,"spinlock_wait_cycles":6656,"thread_start_us":59,"threads_started":1}
I20260807 05:03:43.033377 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.026790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:46567 (local address 127.0.0.1:44752)
0807 05:03:43.027734 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:43.027746 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:43.027884 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:43.028579 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:43.028585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:43.028621 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:43.028799 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.028807 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.030311 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.030313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.031758 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.031766 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.032913 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.032917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.033093 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.033116 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:03:43.033179 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 05:03:43.033243 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":884,"mutex_wait_us":61,"spinlock_wait_cycles":7296,"thread_start_us":91,"threads_started":1}
I20260807 05:03:43.033392 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.026908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60364 (local address 127.25.214.195:40707)
0807 05:03:43.027941 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.027965 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.027987 (+ 22us) server_negotiation.cc:407] Connection header received
0807 05:03:43.028051 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.028055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.028273 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.028407 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:43.028928 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.030171 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.031812 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.032576 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.032689 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.032842 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.033154 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.033248 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":933,"thread_start_us":156,"threads_started":1}
I20260807 05:03:43.033881 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.027178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44752 (local address 127.25.214.193:46567)
0807 05:03:43.027593 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.027605 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.027818 (+ 213us) server_negotiation.cc:407] Connection header received
0807 05:03:43.028032 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.028037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.028273 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.028405 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:43.028928 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.030160 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.031853 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.032567 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.032674 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.032832 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.033577 (+ 745us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.033714 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":114,"threads_started":1}
I20260807 05:03:43.036176 21841 tablet_service.cc:1467] Processing CreateTablet for tablet 32eda4a5d5604fe3862679661b1b0608 (DEFAULT_TABLE table=test-table [id=72c07981ffe64b1eb9d2f0b29ce02016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:43.036314 21634 tablet_service.cc:1467] Processing CreateTablet for tablet 32eda4a5d5604fe3862679661b1b0608 (DEFAULT_TABLE table=test-table [id=72c07981ffe64b1eb9d2f0b29ce02016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:43.036311 22049 tablet_service.cc:1467] Processing CreateTablet for tablet 32eda4a5d5604fe3862679661b1b0608 (DEFAULT_TABLE table=test-table [id=72c07981ffe64b1eb9d2f0b29ce02016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:43.037154 21841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32eda4a5d5604fe3862679661b1b0608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:43.037345 22049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32eda4a5d5604fe3862679661b1b0608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:43.037345 21634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32eda4a5d5604fe3862679661b1b0608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:43.043960 22190 tablet_bootstrap.cc:492] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Bootstrap starting.
I20260807 05:03:43.045243 22194 tablet_bootstrap.cc:492] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: Bootstrap starting.
I20260807 05:03:43.046478 22190 tablet_bootstrap.cc:654] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:43.047375 22194 tablet_bootstrap.cc:654] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:43.047394 22190 log.cc:824] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:43.048219 22193 tablet_bootstrap.cc:492] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Bootstrap starting.
I20260807 05:03:43.048233 22194 log.cc:824] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:43.049618 22190 tablet_bootstrap.cc:492] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: No bootstrap required, opened a new log
I20260807 05:03:43.049822 22190 ts_tablet_manager.cc:1397] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 05:03:43.050217 22193 tablet_bootstrap.cc:654] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:43.050325 22194 tablet_bootstrap.cc:492] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: No bootstrap required, opened a new log
I20260807 05:03:43.050510 22194 ts_tablet_manager.cc:1397] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 05:03:43.050910 22193 log.cc:824] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:43.052544 22193 tablet_bootstrap.cc:492] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: No bootstrap required, opened a new log
I20260807 05:03:43.052714 22193 ts_tablet_manager.cc:1397] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 05:03:43.054167 22190 raft_consensus.cc:348] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.054461 22190 raft_consensus.cc:374] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:43.054522 22190 raft_consensus.cc:729] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc582d7f06f46c1b0dfd888dbda12c5, State: Initialized, Role: FOLLOWER
I20260807 05:03:43.054493 22194 raft_consensus.cc:348] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.054724 22194 raft_consensus.cc:374] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:43.054770 22194 raft_consensus.cc:729] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62d118cd75964a5a93c9730773c7c6e5, State: Initialized, Role: FOLLOWER
I20260807 05:03:43.055051 22190 consensus_queue.cc:260] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.055147 22194 consensus_queue.cc:260] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.056128 22190 ts_tablet_manager.cc:1428] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260807 05:03:43.056128 22194 ts_tablet_manager.cc:1428] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 05:03:43.056241 22193 raft_consensus.cc:348] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.056492 21949 heartbeater.cc:503] Master 127.25.214.254:42351 was elected leader, sending a full tablet report...
I20260807 05:03:43.056492 21743 heartbeater.cc:503] Master 127.25.214.254:42351 was elected leader, sending a full tablet report...
I20260807 05:03:43.056496 22193 raft_consensus.cc:374] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:43.056558 22193 raft_consensus.cc:729] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642d0794fe21466aa854861d197eb238, State: Initialized, Role: FOLLOWER
I20260807 05:03:43.056970 22193 consensus_queue.cc:260] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.057569 22158 heartbeater.cc:503] Master 127.25.214.254:42351 was elected leader, sending a full tablet report...
I20260807 05:03:43.057964 22193 ts_tablet_manager.cc:1428] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 05:03:43.121969 21744 tablet.cc:2369] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:03:43.130625 22203 raft_consensus.cc:482] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:43.130828 22203 raft_consensus.cc:504] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.131927 22203 leader_election.cc:288] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642d0794fe21466aa854861d197eb238 (127.25.214.195:40707), cbc582d7f06f46c1b0dfd888dbda12c5 (127.25.214.194:36185)
I20260807 05:03:43.135818 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.132289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:50291 (local address 127.25.214.195:40707)
0807 05:03:43.132430 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.132435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.132450 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:03:43.132508 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.132511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.132556 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.132633 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:43.132942 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.133455 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.134746 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.135350 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.135449 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.135490 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.135659 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.135711 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 05:03:43.135850 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.132186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:40707 (local address 127.25.214.193:50291)
0807 05:03:43.132304 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:43.132317 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:43.132421 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:43.132658 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:43.132661 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:43.132683 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:43.132807 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.132814 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.133558 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.133561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.134628 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.134638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.135451 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.135455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.135550 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.135576 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 05:03:43.135648 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 05:03:43.135714 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 05:03:43.136457 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.132671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:53183 (local address 127.25.214.194:36185)
0807 05:03:43.132808 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.132812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.132889 (+ 77us) server_negotiation.cc:407] Connection header received
0807 05:03:43.133018 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.133021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.133063 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.133137 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:43.133401 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.134134 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.135380 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.135926 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.136038 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.136105 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.136310 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.136368 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 05:03:43.136478 22207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.132507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36185 (local address 127.25.214.193:53183)
0807 05:03:43.132821 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:43.132834 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:43.132916 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:43.133151 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:43.133154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:43.133170 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:43.133291 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.133297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.134255 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.134259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.135257 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:43.135269 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.136100 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.136104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:43.136198 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.136217 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 05:03:43.136279 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 05:03:43.136344 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":95,"threads_started":1}
I20260807 05:03:43.136621 22081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32eda4a5d5604fe3862679661b1b0608" candidate_uuid: "62d118cd75964a5a93c9730773c7c6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642d0794fe21466aa854861d197eb238" is_pre_election: true
I20260807 05:03:43.136933 22081 raft_consensus.cc:2454] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62d118cd75964a5a93c9730773c7c6e5 in term 0.
I20260807 05:03:43.137127 21879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32eda4a5d5604fe3862679661b1b0608" candidate_uuid: "62d118cd75964a5a93c9730773c7c6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" is_pre_election: true
I20260807 05:03:43.137422 21879 raft_consensus.cc:2454] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62d118cd75964a5a93c9730773c7c6e5 in term 0.
I20260807 05:03:43.137467 21563 leader_election.cc:302] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62d118cd75964a5a93c9730773c7c6e5, 642d0794fe21466aa854861d197eb238; no voters:
I20260807 05:03:43.137770 22203 raft_consensus.cc:2781] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:43.137856 22203 raft_consensus.cc:482] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:43.137897 22203 raft_consensus.cc:3037] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:43.139178 22203 raft_consensus.cc:504] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.139509 22203 leader_election.cc:288] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 642d0794fe21466aa854861d197eb238 (127.25.214.195:40707), cbc582d7f06f46c1b0dfd888dbda12c5 (127.25.214.194:36185)
I20260807 05:03:43.139854 22081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32eda4a5d5604fe3862679661b1b0608" candidate_uuid: "62d118cd75964a5a93c9730773c7c6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642d0794fe21466aa854861d197eb238"
I20260807 05:03:43.139923 21879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32eda4a5d5604fe3862679661b1b0608" candidate_uuid: "62d118cd75964a5a93c9730773c7c6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5"
I20260807 05:03:43.139976 22081 raft_consensus.cc:3037] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:43.140065 21879 raft_consensus.cc:3037] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:43.141063 22081 raft_consensus.cc:2454] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62d118cd75964a5a93c9730773c7c6e5 in term 1.
I20260807 05:03:43.141131 21879 raft_consensus.cc:2454] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62d118cd75964a5a93c9730773c7c6e5 in term 1.
I20260807 05:03:43.141433 21563 leader_election.cc:302] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62d118cd75964a5a93c9730773c7c6e5, 642d0794fe21466aa854861d197eb238; no voters:
I20260807 05:03:43.141597 22203 raft_consensus.cc:2781] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:43.141814 22203 raft_consensus.cc:686] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 62d118cd75964a5a93c9730773c7c6e5, State: Running, Role: LEADER
I20260807 05:03:43.142190 22203 consensus_queue.cc:237] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } }
I20260807 05:03:43.145464 21450 catalog_manager.cc:5495] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62d118cd75964a5a93c9730773c7c6e5 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "62d118cd75964a5a93c9730773c7c6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62d118cd75964a5a93c9730773c7c6e5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260807 05:03:43.161537 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.158390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44764 (local address 127.25.214.193:46567)
0807 05:03:43.158520 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:43.158523 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:43.158535 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:03:43.158628 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:43.158631 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:43.158690 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:43.158777 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:43.158984 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.159489 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.160279 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:43.160497 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:43.160568 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:43.160785 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:43.161210 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:43.161298 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:43.161356 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 05:03:43.161402 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 05:03:43.167318 22081 raft_consensus.cc:1261] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 1 FOLLOWER]: Refusing update from remote peer 62d118cd75964a5a93c9730773c7c6e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:43.167318 21879 raft_consensus.cc:1261] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 1 FOLLOWER]: Refusing update from remote peer 62d118cd75964a5a93c9730773c7c6e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:43.168009 22208 consensus_queue.cc:1035] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc582d7f06f46c1b0dfd888dbda12c5" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:43.168215 22203 consensus_queue.cc:1035] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642d0794fe21466aa854861d197eb238" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 40707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:43.176905 22214 mvcc.cc:205] Tried to move back new op lower bound from 7315779678886387712 to 7315779678792986624. Current Snapshot: MvccSnapshot[applied={T|T < 7315779678886387712}]
I20260807 05:03:43.177737 22215 mvcc.cc:205] Tried to move back new op lower bound from 7315779678886387712 to 7315779678792986624. Current Snapshot: MvccSnapshot[applied={T|T < 7315779678886387712 or (T in {7315779678886387712})}]
I20260807 05:03:43.183388 21450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:43.183566 21450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:43.185907 21450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8104b401aea545b0af90441f6db49357: Sending DeleteTablet for 3 replicas of tablet 32eda4a5d5604fe3862679661b1b0608
I20260807 05:03:43.186717 21634 tablet_service.cc:1514] Processing DeleteTablet for tablet 32eda4a5d5604fe3862679661b1b0608 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:43 UTC) from {username='slave'} at 127.0.0.1:44752
I20260807 05:03:43.186998 21841 tablet_service.cc:1514] Processing DeleteTablet for tablet 32eda4a5d5604fe3862679661b1b0608 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:43 UTC) from {username='slave'} at 127.0.0.1:58418
I20260807 05:03:43.187253 22049 tablet_service.cc:1514] Processing DeleteTablet for tablet 32eda4a5d5604fe3862679661b1b0608 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:43 UTC) from {username='slave'} at 127.0.0.1:60364
I20260807 05:03:43.187528 22226 tablet_replica.cc:330] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5: stopping tablet replica
I20260807 05:03:43.187748 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 21539
I20260807 05:03:43.187860 22226 raft_consensus.cc:2229] T 32eda4a5d5604fe3862679661b1b0608 P 62d118cd75964a5a93c9730773c7c6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:03:43.188341 22227 tablet_replica.cc:330] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: stopping tablet replica
I20260807 05:03:43.188570 22227 raft_consensus.cc:2229] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:43.188819 22227 raft_consensus.cc:2258] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:43.191922 22227 ts_tablet_manager.cc:1905] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:43.194922 22227 ts_tablet_manager.cc:1918] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:43.194947 22229 tablet_replica.cc:330] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: stopping tablet replica
I20260807 05:03:43.195039 22227 log.cc:1196] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/32eda4a5d5604fe3862679661b1b0608
I20260807 05:03:43.195317 22229 raft_consensus.cc:2229] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:43.195363 22227 ts_tablet_manager.cc:1939] T 32eda4a5d5604fe3862679661b1b0608 P cbc582d7f06f46c1b0dfd888dbda12c5: Deleting consensus metadata
I20260807 05:03:43.195724 22229 raft_consensus.cc:2258] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:43.196759 21427 catalog_manager.cc:4841] TS cbc582d7f06f46c1b0dfd888dbda12c5 (127.25.214.194:36185): tablet 32eda4a5d5604fe3862679661b1b0608 (table test-table [id=72c07981ffe64b1eb9d2f0b29ce02016]) successfully deleted
I20260807 05:03:43.197374 22229 ts_tablet_manager.cc:1905] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:43.199658 22229 ts_tablet_manager.cc:1918] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:43.199761 22229 log.cc:1196] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/32eda4a5d5604fe3862679661b1b0608
I20260807 05:03:43.200031 22229 ts_tablet_manager.cc:1939] T 32eda4a5d5604fe3862679661b1b0608 P 642d0794fe21466aa854861d197eb238: Deleting consensus metadata
I20260807 05:03:43.201267 21427 catalog_manager.cc:4841] TS 642d0794fe21466aa854861d197eb238 (127.25.214.195:40707): tablet 32eda4a5d5604fe3862679661b1b0608 (table test-table [id=72c07981ffe64b1eb9d2f0b29ce02016]) successfully deleted
W20260807 05:03:43.202042 21431 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:46567 (error 108)
I20260807 05:03:43.202833 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 21746
I20260807 05:03:43.203102 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:43.202794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:46567 (local address 127.0.0.1:44768)
0807 05:03:43.202938 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:43.203013 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:46567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 05:03:43.207312 21431 catalog_manager.cc:4584] TS 62d118cd75964a5a93c9730773c7c6e5 (127.25.214.193:46567): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 32eda4a5d5604fe3862679661b1b0608: Network error: Client connection negotiation failed: client connection to 127.25.214.193:46567: connect: Connection refused (error 111)
I20260807 05:03:43.214037 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 21952
I20260807 05:03:43.236006 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 21399
2026-08-07T05:03:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1100 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:43 dist-test-slave-lgr5 krb5kdc[22234](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:43 dist-test-slave-lgr5 krb5kdc[22234](info): set up 2 sockets
Aug 07 05:03:43 dist-test-slave-lgr5 krb5kdc[22234](info): commencing operation
krb5kdc: starting...
W20260807 05:03:44.385458 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:44 dist-test-slave-lgr5 krb5kdc[22234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:03:44.514707 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:38085
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:38085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:44.630963 22254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:44.631304 22254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:44.631373 22254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:44.635584 22254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:44.635684 22254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:44.635715 22254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:44.635740 22254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:44.635766 22254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:44.641819 22254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:38085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:38085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:44.643033 22254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:44.644184 22254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:44.652753 22261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:44.652773 22260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:44.652834 22254 server_base.cc:1034] running on GCE node
W20260807 05:03:44.652773 22265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:44.653657 22254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:44.654816 22254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:44.655977 22254 hybrid_clock.cc:648] HybridClock initialized: now 1786079024655956 us; error 39 us; skew 500 ppm
Aug 07 05:03:44 dist-test-slave-lgr5 krb5kdc[22234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:44.658756 22254 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:03:44.659619 22254 webserver.cc:460] Webserver started at http://127.25.214.254:36985/ using document root <none> and password file <none>
I20260807 05:03:44.660185 22254 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:44.660251 22254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:44.660429 22254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:44.662587 22254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "b634f2d3dbf440eda1d6b9ea49e93227"
format_stamp: "Formatted at 2026-08-07 05:03:44 on dist-test-slave-lgr5"
server_key: "572f884a862e172a69197d2fea78f3e1"
server_key_iv: "52e4863bc7364285d73379a664bf9e8f"
server_key_version: "encryptionkey@0"
I20260807 05:03:44.663170 22254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "b634f2d3dbf440eda1d6b9ea49e93227"
format_stamp: "Formatted at 2026-08-07 05:03:44 on dist-test-slave-lgr5"
server_key: "572f884a862e172a69197d2fea78f3e1"
server_key_iv: "52e4863bc7364285d73379a664bf9e8f"
server_key_version: "encryptionkey@0"
I20260807 05:03:44.667559 22254 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 05:03:44.670153 22273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:44.671381 22254 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:44.671500 22254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "b634f2d3dbf440eda1d6b9ea49e93227"
format_stamp: "Formatted at 2026-08-07 05:03:44 on dist-test-slave-lgr5"
server_key: "572f884a862e172a69197d2fea78f3e1"
server_key_iv: "52e4863bc7364285d73379a664bf9e8f"
server_key_version: "encryptionkey@0"
I20260807 05:03:44.671619 22254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:44.690380 22254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:44.693744 22254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:44.693946 22254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:44.701016 22254 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:38085
I20260807 05:03:44.701135 22359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:38085 every 8 connection(s)
I20260807 05:03:44.702064 22254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:44.704973 22360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:44.710700 22360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227: Bootstrap starting.
I20260807 05:03:44.711922 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 22254
I20260807 05:03:44.712065 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:44.712354 26459 external_mini_cluster.cc:1428] Setting key 7d05a260ac043d0043335705c052d9cb
I20260807 05:03:44.713516 22360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:44.714277 22360 log.cc:824] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:44.716614 22360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227: No bootstrap required, opened a new log
I20260807 05:03:44.721225 22360 raft_consensus.cc:348] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38085 } }
I20260807 05:03:44.721522 22360 raft_consensus.cc:374] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:44.721596 22360 raft_consensus.cc:729] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b634f2d3dbf440eda1d6b9ea49e93227, State: Initialized, Role: FOLLOWER
Aug 07 05:03:44 dist-test-slave-lgr5 krb5kdc[22234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:44.722141 22360 consensus_queue.cc:260] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38085 } }
I20260807 05:03:44.722321 22360 raft_consensus.cc:388] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:44.722412 22360 raft_consensus.cc:482] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:44.722517 22360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:44.723708 22360 raft_consensus.cc:504] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38085 } }
I20260807 05:03:44.724068 22360 leader_election.cc:302] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b634f2d3dbf440eda1d6b9ea49e93227; no voters:
I20260807 05:03:44.724478 22360 leader_election.cc:288] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:44.724570 22370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:44.724800 22370 raft_consensus.cc:686] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [term 1 LEADER]: Becoming Leader. State: Replica: b634f2d3dbf440eda1d6b9ea49e93227, State: Running, Role: LEADER
I20260807 05:03:44.725154 22370 consensus_queue.cc:237] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38085 } }
I20260807 05:03:44.725903 22360 sys_catalog.cc:564] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:44.726919 22372 sys_catalog.cc:455] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b634f2d3dbf440eda1d6b9ea49e93227. Latest consensus state: current_term: 1 leader_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38085 } } }
I20260807 05:03:44.727064 22372 sys_catalog.cc:458] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:44.727459 22384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:44.728791 22367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:44.713527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54504 (local address 127.25.214.254:38085)
0807 05:03:44.713992 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:44.714009 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:44.714044 (+ 35us) server_negotiation.cc:407] Connection header received
0807 05:03:44.714759 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:44.714780 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:44.715128 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:44.715410 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:44.716374 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:44.717433 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:44.718668 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:44.719224 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:44.719363 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:44.722429 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:44.722436 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:44.722454 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:44.722493 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:44.724275 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:44.724818 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:44.724825 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:44.724832 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:44.725044 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:44.725391 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:44.725395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:44.725397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:44.725931 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:44.726168 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:44.727451 (+ 1283us) server_negotiation.cc:299] Negotiation successful
0807 05:03:44.727768 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":135,"threads_started":1}
I20260807 05:03:44.728962 22371 sys_catalog.cc:455] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b634f2d3dbf440eda1d6b9ea49e93227" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 38085 } } }
I20260807 05:03:44.729095 22371 sys_catalog.cc:458] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:44.730815 22384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:44.737052 22384 catalog_manager.cc:1347] Generated new cluster ID: a4e89e3dcb9a48e4a566c56e5c920799
I20260807 05:03:44.737118 22384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:44.748345 22384 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:44.749320 22384 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:44.764202 22384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227: Generated new TSK 0
I20260807 05:03:44.764992 22384 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:03:44.797360 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38085
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:44.913381 22402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:44.913661 22402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:44.913705 22402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:44.917765 22402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:44.917840 22402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:44.917897 22402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:44.923516 22402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:44.924721 22402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:44.925776 22402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:44.936040 22419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:44.936040 22429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:44.936050 22425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:44.936424 22402 server_base.cc:1034] running on GCE node
I20260807 05:03:44.936892 22402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:44.937570 22402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:44.938740 22402 hybrid_clock.cc:648] HybridClock initialized: now 1786079024938710 us; error 40 us; skew 500 ppm
Aug 07 05:03:44 dist-test-slave-lgr5 krb5kdc[22234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:44.941680 22402 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:03:44.942575 22402 webserver.cc:460] Webserver started at http://127.25.214.193:41305/ using document root <none> and password file <none>
I20260807 05:03:44.943137 22402 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:44.943207 22402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:44.943410 22402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:44.945626 22402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "6487fec5386448789a8366c68533f627"
format_stamp: "Formatted at 2026-08-07 05:03:44 on dist-test-slave-lgr5"
server_key: "daef09f252aad980b335f03d764ffec3"
server_key_iv: "ff76d0c341c3601ff1d1f1b1184c9b39"
server_key_version: "encryptionkey@0"
I20260807 05:03:44.946306 22402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "6487fec5386448789a8366c68533f627"
format_stamp: "Formatted at 2026-08-07 05:03:44 on dist-test-slave-lgr5"
server_key: "daef09f252aad980b335f03d764ffec3"
server_key_iv: "ff76d0c341c3601ff1d1f1b1184c9b39"
server_key_version: "encryptionkey@0"
I20260807 05:03:44.950354 22402 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:03:44.953087 22441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:44.954427 22402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:44.954546 22402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "6487fec5386448789a8366c68533f627"
format_stamp: "Formatted at 2026-08-07 05:03:44 on dist-test-slave-lgr5"
server_key: "daef09f252aad980b335f03d764ffec3"
server_key_iv: "ff76d0c341c3601ff1d1f1b1184c9b39"
server_key_version: "encryptionkey@0"
I20260807 05:03:44.954664 22402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:44.971936 22402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:44.975306 22402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:44.975507 22402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:44.976135 22402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:44.976994 22402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:44.977041 22402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:44.977101 22402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:44.977130 22402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:44.985386 22402 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:45783
I20260807 05:03:44.985430 22621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:45783 every 8 connection(s)
I20260807 05:03:44.986280 22402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:44.994871 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 22402
I20260807 05:03:44.995044 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:03:44.995360 26459 external_mini_cluster.cc:1428] Setting key f0c523d87880f3aa991fda175c65d4e9
Aug 07 05:03:44 dist-test-slave-lgr5 krb5kdc[22234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:44.999704 22367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:44.988057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:37953 (local address 127.25.214.254:38085)
0807 05:03:44.988192 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:44.988196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:44.989031 (+ 835us) server_negotiation.cc:407] Connection header received
0807 05:03:44.990325 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:44.990328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:44.990388 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:44.990466 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:44.991630 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:44.992198 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:44.993326 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:44.993559 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:44.993646 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:44.996182 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:44.996185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:44.996188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:44.996214 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:44.997606 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:44.998185 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:44.998187 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:44.998189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:44.998262 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:44.998590 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:44.998592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:44.998593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:44.998760 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:44.998853 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:44.999402 (+ 549us) server_negotiation.cc:299] Negotiation successful
0807 05:03:44.999538 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:03:45.000517 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:44.988435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38085 (local address 127.25.214.193:37953)
0807 05:03:44.988873 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:44.988925 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:44.990118 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:44.990644 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:44.990650 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:44.990999 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:44.991483 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:44.991497 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:44.992312 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:44.992315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:44.993207 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:44.993217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:44.993700 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:44.993704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:44.993864 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:44.994386 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:44.994402 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:44.996004 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:44.997725 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:44.997732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:44.997748 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:44.998097 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:44.998331 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:44.998334 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:44.998336 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:44.998507 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:44.998858 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:44.998865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:44.999175 (+ 310us) client_negotiation.cc:769] Sending connection context
0807 05:03:44.999336 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 05:03:44.999597 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":104,"threads_started":1}
I20260807 05:03:45.001845 22622 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38085
I20260807 05:03:45.002139 22622 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:45.002779 22622 heartbeater.cc:511] Master 127.25.214.254:38085 requested a full tablet report, sending...
I20260807 05:03:45.004828 22303 ts_manager.cc:194] Registered new tserver with Master: 6487fec5386448789a8366c68533f627 (127.25.214.193:45783)
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:03:45.006453 22303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:37953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:03:45.024904 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38085
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:45.137070 22629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:45.137308 22629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:45.137355 22629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:45.141450 22629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:45.141513 22629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:45.141577 22629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:45.146802 22629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:45.147888 22629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:45.148964 22629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:45.158620 22642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:45.158620 22638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:45.158622 22639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:45.159161 22629 server_base.cc:1034] running on GCE node
I20260807 05:03:45.159657 22629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:45.160501 22629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:45.161681 22629 hybrid_clock.cc:648] HybridClock initialized: now 1786079025161662 us; error 37 us; skew 500 ppm
Aug 07 05:03:45 dist-test-slave-lgr5 krb5kdc[22234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079025, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:45.164759 22629 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:03:45.165769 22629 webserver.cc:460] Webserver started at http://127.25.214.194:41417/ using document root <none> and password file <none>
I20260807 05:03:45.166356 22629 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:45.166436 22629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:45.166657 22629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:45.168991 22629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "59848d1b96a94ef2adf9cd06abbb6179"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "4779b91eeb7fafbdf3383fb24a40267c"
server_key_iv: "6f9d79ea8b12ef017a5e85a26a991bc0"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.169674 22629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "59848d1b96a94ef2adf9cd06abbb6179"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "4779b91eeb7fafbdf3383fb24a40267c"
server_key_iv: "6f9d79ea8b12ef017a5e85a26a991bc0"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.173878 22629 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:03:45.176748 22651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.178081 22629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:45.178205 22629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "59848d1b96a94ef2adf9cd06abbb6179"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "4779b91eeb7fafbdf3383fb24a40267c"
server_key_iv: "6f9d79ea8b12ef017a5e85a26a991bc0"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.178316 22629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:45.206545 22629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:45.209797 22629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:45.209987 22629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:45.210615 22629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:45.211473 22629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:45.211524 22629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.211580 22629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:45.211606 22629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.220357 22629 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:41241
I20260807 05:03:45.220391 22843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:41241 every 8 connection(s)
I20260807 05:03:45.221267 22629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:45.222389 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 22629
I20260807 05:03:45.222508 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:03:45.222808 26459 external_mini_cluster.cc:1428] Setting key 6d539334c1558597d9121598606a0c56
Aug 07 05:03:45 dist-test-slave-lgr5 krb5kdc[22234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079025, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:03:45.236294 22367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.223229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:54267 (local address 127.25.214.254:38085)
0807 05:03:45.223367 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.223372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.224227 (+ 855us) server_negotiation.cc:407] Connection header received
0807 05:03:45.225648 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.225651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.225703 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.225781 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:45.227382 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.227907 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.229604 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.229816 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.229898 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.232742 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:45.232746 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:45.232748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:45.232772 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:45.234173 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:45.234782 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:45.234786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:45.234787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:45.234869 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:45.235178 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:45.235181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:45.235182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:45.235374 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:45.235447 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.235976 (+ 529us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.236129 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
I20260807 05:03:45.237210 22847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.223491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38085 (local address 127.25.214.194:54267)
0807 05:03:45.224034 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.224120 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.225436 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.225974 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.225982 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.226435 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:45.227212 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.227234 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.228066 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.228070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.229471 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.229484 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.229973 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.229977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.230179 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.230804 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:45.230826 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:45.232566 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:45.234288 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:45.234294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:45.234307 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:45.234562 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:45.234942 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:45.234944 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:45.234946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:45.235092 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:45.235461 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:45.235466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:45.235749 (+ 283us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.235910 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.236247 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":130,"threads_started":1}
I20260807 05:03:45.238446 22844 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38085
I20260807 05:03:45.238693 22844 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:45.239218 22844 heartbeater.cc:511] Master 127.25.214.254:38085 requested a full tablet report, sending...
I20260807 05:03:45.240331 22303 ts_manager.cc:194] Registered new tserver with Master: 59848d1b96a94ef2adf9cd06abbb6179 (127.25.214.194:41241)
I20260807 05:03:45.240955 22303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:54267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:03:45.252828 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38085
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:45.369320 22855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:45.369602 22855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:45.369665 22855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:45.373871 22855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:45.373970 22855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:45.374051 22855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:45.379796 22855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:45.380965 22855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:45.382046 22855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:45.391752 22862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:45.391750 22861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:45.391845 22855 server_base.cc:1034] running on GCE node
W20260807 05:03:45.391746 22864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:45.392475 22855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:45.393107 22855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:45.394281 22855 hybrid_clock.cc:648] HybridClock initialized: now 1786079025394243 us; error 49 us; skew 500 ppm
Aug 07 05:03:45 dist-test-slave-lgr5 krb5kdc[22234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079025, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:45.397113 22855 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:03:45.397982 22855 webserver.cc:460] Webserver started at http://127.25.214.195:35235/ using document root <none> and password file <none>
I20260807 05:03:45.398527 22855 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:45.398588 22855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:45.398756 22855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:45.400959 22855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "81e934c56b2e4c9e99163e944cc19b8d"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "c65298e8a6d1de9545a90e84f550fe6b"
server_key_iv: "2daf830f6d871298370526abae68db85"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.401467 22855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "81e934c56b2e4c9e99163e944cc19b8d"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "c65298e8a6d1de9545a90e84f550fe6b"
server_key_iv: "2daf830f6d871298370526abae68db85"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.405174 22855 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:45.407622 22877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.408914 22855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:45.409044 22855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "81e934c56b2e4c9e99163e944cc19b8d"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "c65298e8a6d1de9545a90e84f550fe6b"
server_key_iv: "2daf830f6d871298370526abae68db85"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.409157 22855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:45.440237 22855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:45.443267 22855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:45.443449 22855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:45.444072 22855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:45.444958 22855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:45.445007 22855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.445061 22855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:45.445091 22855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.453850 22855 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:44423
I20260807 05:03:45.453879 23074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:44423 every 8 connection(s)
I20260807 05:03:45.454717 22855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:45.460800 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 22855
I20260807 05:03:45.460937 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:03:45.461246 26459 external_mini_cluster.cc:1428] Setting key ec78b2c28cfbf4bf6f8324aedf7ad441
Aug 07 05:03:45 dist-test-slave-lgr5 krb5kdc[22234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079025, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:45.468324 22367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.456509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:50347 (local address 127.25.214.254:38085)
0807 05:03:45.456638 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.456642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.457449 (+ 807us) server_negotiation.cc:407] Connection header received
0807 05:03:45.458867 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.458870 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.458940 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.459013 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:45.460246 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.460935 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.462149 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.462375 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.462467 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.464966 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:45.464969 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:45.464971 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:45.464996 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:45.466170 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:45.466660 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:45.466663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:45.466664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:45.466742 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:45.467065 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:45.467069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:45.467070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:45.467257 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:45.467344 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.467991 (+ 647us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.468160 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:03:45.469192 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.456864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:38085 (local address 127.25.214.195:50347)
0807 05:03:45.457298 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.457340 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.458629 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.459207 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.459214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.459577 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:45.460063 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.460111 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.461092 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.461095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.462022 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.462033 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.462522 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.462525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.462684 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.463231 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:45.463248 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:45.464801 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:45.466283 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:45.466288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:45.466304 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:45.466558 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:45.466827 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:45.466835 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:45.466837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:45.466975 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:45.467387 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:45.467393 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:45.467637 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.467945 (+ 308us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.468325 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":104,"threads_started":1}
I20260807 05:03:45.470284 23075 heartbeater.cc:347] Connected to a master server at 127.25.214.254:38085
I20260807 05:03:45.470531 23075 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:45.471019 23075 heartbeater.cc:511] Master 127.25.214.254:38085 requested a full tablet report, sending...
I20260807 05:03:45.472018 22303 ts_manager.cc:194] Registered new tserver with Master: 81e934c56b2e4c9e99163e944cc19b8d (127.25.214.195:44423)
I20260807 05:03:45.472602 22303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:50347
I20260807 05:03:45.474887 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:45.484069 22367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.476896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54508 (local address 127.25.214.254:38085)
0807 05:03:45.477016 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.477019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.477166 (+ 147us) server_negotiation.cc:407] Connection header received
0807 05:03:45.477290 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.477292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.477331 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.477387 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:45.478045 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.478554 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.479304 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.479514 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.479579 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.481032 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:45.481035 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:45.481037 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:45.481061 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:45.482478 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:45.482987 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:45.482990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:45.482991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:45.483064 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:45.483289 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:45.483291 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:45.483292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:45.483497 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:45.483618 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.483868 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.483944 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:03:45.487036 22303 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:45.490176 22303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:45.505180 23096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.498812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41858 (local address 127.25.214.194:41241)
0807 05:03:45.499396 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.499410 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.500055 (+ 645us) server_negotiation.cc:407] Connection header received
0807 05:03:45.500160 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.500165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.500371 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.500555 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:45.500879 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.502105 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.503777 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.504474 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.504595 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.504755 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.504907 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.505017 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":114,"threads_started":1}
I20260807 05:03:45.505314 23094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.498796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:44423 (local address 127.0.0.1:43822)
0807 05:03:45.499721 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.499773 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.499916 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.500679 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.500681 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.500696 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:45.500809 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.500814 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.502254 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.502258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.503709 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.503718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.504946 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.504949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.505020 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.505039 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.505094 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.505160 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":233,"spinlock_wait_cycles":263424,"thread_start_us":106,"threads_started":1}
I20260807 05:03:45.505479 23101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.499903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35626 (local address 127.25.214.193:45783)
0807 05:03:45.500269 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.500286 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.500365 (+ 79us) server_negotiation.cc:407] Connection header received
0807 05:03:45.500518 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.500524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.500689 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.500819 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:45.501021 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.501835 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.503622 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.504546 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.504674 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.504812 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.505242 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.505342 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":94,"threads_started":1}
I20260807 05:03:45.505729 23099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.499365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:45783 (local address 127.0.0.1:35626)
0807 05:03:45.500284 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.500298 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.500391 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.500817 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.500820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.500838 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:45.500927 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.500932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.501945 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.501949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.503480 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.503492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.504892 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.504896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.504985 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.505008 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.505080 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.505160 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":81,"thread_start_us":82,"threads_started":1}
I20260807 05:03:45.505749 23098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.499137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43822 (local address 127.25.214.195:44423)
0807 05:03:45.499611 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.499624 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.500062 (+ 438us) server_negotiation.cc:407] Connection header received
0807 05:03:45.500166 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.500171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.500377 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.500529 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:45.500925 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.502105 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.503807 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.504682 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.504792 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.504894 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.505521 (+ 627us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.505619 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":168,"threads_started":1}
I20260807 05:03:45.505178 23093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.498677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:41241 (local address 127.0.0.1:41858)
0807 05:03:45.499720 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.499772 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.499917 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.500553 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.500558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.500580 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:45.500740 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.500747 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.502254 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.502258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.503639 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.503651 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.504594 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.504598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.504715 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.504754 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.504873 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.505017 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":122,"spinlock_wait_cycles":5504,"thread_start_us":77,"threads_started":1}
I20260807 05:03:45.508706 22952 tablet_service.cc:1467] Processing CreateTablet for tablet 93d9f801b282423595cdc0508763c5a3 (DEFAULT_TABLE table=test-table [id=25f59910a4164d7e9166eb7613bb79a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:45.508872 22728 tablet_service.cc:1467] Processing CreateTablet for tablet 93d9f801b282423595cdc0508763c5a3 (DEFAULT_TABLE table=test-table [id=25f59910a4164d7e9166eb7613bb79a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:45.508872 22512 tablet_service.cc:1467] Processing CreateTablet for tablet 93d9f801b282423595cdc0508763c5a3 (DEFAULT_TABLE table=test-table [id=25f59910a4164d7e9166eb7613bb79a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:45.509711 22952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d9f801b282423595cdc0508763c5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:45.509887 22512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d9f801b282423595cdc0508763c5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:45.509887 22728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d9f801b282423595cdc0508763c5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:45.518040 23103 tablet_bootstrap.cc:492] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Bootstrap starting.
I20260807 05:03:45.519085 23105 tablet_bootstrap.cc:492] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Bootstrap starting.
I20260807 05:03:45.519716 23104 tablet_bootstrap.cc:492] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: Bootstrap starting.
I20260807 05:03:45.520454 23103 tablet_bootstrap.cc:654] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:45.521311 23105 tablet_bootstrap.cc:654] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:45.521808 23104 tablet_bootstrap.cc:654] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:45.521766 23103 log.cc:824] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:45.522608 23105 log.cc:824] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:45.522672 23104 log.cc:824] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:45.524205 23103 tablet_bootstrap.cc:492] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: No bootstrap required, opened a new log
I20260807 05:03:45.524396 23103 ts_tablet_manager.cc:1397] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 05:03:45.524470 23105 tablet_bootstrap.cc:492] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: No bootstrap required, opened a new log
I20260807 05:03:45.524665 23105 ts_tablet_manager.cc:1397] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:03:45.525355 23104 tablet_bootstrap.cc:492] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: No bootstrap required, opened a new log
I20260807 05:03:45.525545 23104 ts_tablet_manager.cc:1397] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 05:03:45.527701 23103 raft_consensus.cc:348] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.527931 23103 raft_consensus.cc:374] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:45.527992 23103 raft_consensus.cc:729] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81e934c56b2e4c9e99163e944cc19b8d, State: Initialized, Role: FOLLOWER
I20260807 05:03:45.528424 23103 consensus_queue.cc:260] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.528628 23105 raft_consensus.cc:348] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.528873 23105 raft_consensus.cc:374] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:45.528926 23105 raft_consensus.cc:729] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59848d1b96a94ef2adf9cd06abbb6179, State: Initialized, Role: FOLLOWER
I20260807 05:03:45.529356 23105 consensus_queue.cc:260] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.529531 23103 ts_tablet_manager.cc:1428] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:03:45.529888 23075 heartbeater.cc:503] Master 127.25.214.254:38085 was elected leader, sending a full tablet report...
I20260807 05:03:45.529968 23104 raft_consensus.cc:348] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.530241 23104 raft_consensus.cc:374] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:45.530320 23105 ts_tablet_manager.cc:1428] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 05:03:45.530315 23104 raft_consensus.cc:729] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6487fec5386448789a8366c68533f627, State: Initialized, Role: FOLLOWER
I20260807 05:03:45.530705 22844 heartbeater.cc:503] Master 127.25.214.254:38085 was elected leader, sending a full tablet report...
I20260807 05:03:45.530723 23104 consensus_queue.cc:260] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.531361 22622 heartbeater.cc:503] Master 127.25.214.254:38085 was elected leader, sending a full tablet report...
I20260807 05:03:45.531636 23104 ts_tablet_manager.cc:1428] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:03:45.567726 23111 raft_consensus.cc:482] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:45.567957 23111 raft_consensus.cc:504] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.569183 23111 leader_election.cc:288] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59848d1b96a94ef2adf9cd06abbb6179 (127.25.214.194:41241), 6487fec5386448789a8366c68533f627 (127.25.214.193:45783)
I20260807 05:03:45.573892 23096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.569546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:45773 (local address 127.25.214.194:41241)
0807 05:03:45.569675 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.569681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.569698 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:03:45.569842 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.569845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.569901 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.569979 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:45.570278 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.571040 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.572538 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.573187 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.573330 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.573398 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.573684 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.573762 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:03:45.573892 23101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.569897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:46297 (local address 127.25.214.193:45783)
0807 05:03:45.570034 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.570039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.570141 (+ 102us) server_negotiation.cc:407] Connection header received
0807 05:03:45.570248 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.570252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.570307 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.570420 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:45.570639 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.571287 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.572655 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.573252 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.573388 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.573437 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.573684 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.573762 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 05:03:45.573904 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.569441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:41241 (local address 127.25.214.195:45773)
0807 05:03:45.569582 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.569600 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.569705 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.570027 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.570031 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.570053 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:45.570177 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.570184 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.571160 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.571162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.572398 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.572410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.573337 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.573341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.573460 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.573549 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.573634 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.573740 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":46}
I20260807 05:03:45.573918 23122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.569707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:45783 (local address 127.25.214.195:46297)
0807 05:03:45.570049 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.570062 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:45.570157 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:45.570428 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:45.570430 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:45.570447 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:45.570542 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.570546 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.571389 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.571393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.572536 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:45.572543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.573388 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.573391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:45.573515 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.573556 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 05:03:45.573633 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 05:03:45.573740 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":48,"thread_start_us":128,"threads_started":1}
I20260807 05:03:45.574618 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d9f801b282423595cdc0508763c5a3" candidate_uuid: "81e934c56b2e4c9e99163e944cc19b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59848d1b96a94ef2adf9cd06abbb6179" is_pre_election: true
I20260807 05:03:45.574725 22541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d9f801b282423595cdc0508763c5a3" candidate_uuid: "81e934c56b2e4c9e99163e944cc19b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6487fec5386448789a8366c68533f627" is_pre_election: true
I20260807 05:03:45.574957 22764 raft_consensus.cc:2454] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81e934c56b2e4c9e99163e944cc19b8d in term 0.
I20260807 05:03:45.574992 22541 raft_consensus.cc:2454] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81e934c56b2e4c9e99163e944cc19b8d in term 0.
I20260807 05:03:45.575467 22878 leader_election.cc:302] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6487fec5386448789a8366c68533f627, 81e934c56b2e4c9e99163e944cc19b8d; no voters:
I20260807 05:03:45.575733 23111 raft_consensus.cc:2781] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:45.575817 23111 raft_consensus.cc:482] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:45.575847 23111 raft_consensus.cc:3037] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:45.577114 23111 raft_consensus.cc:504] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.577451 23111 leader_election.cc:288] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [CANDIDATE]: Term 1 election: Requested vote from peers 59848d1b96a94ef2adf9cd06abbb6179 (127.25.214.194:41241), 6487fec5386448789a8366c68533f627 (127.25.214.193:45783)
I20260807 05:03:45.577809 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d9f801b282423595cdc0508763c5a3" candidate_uuid: "81e934c56b2e4c9e99163e944cc19b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59848d1b96a94ef2adf9cd06abbb6179"
I20260807 05:03:45.577841 22541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d9f801b282423595cdc0508763c5a3" candidate_uuid: "81e934c56b2e4c9e99163e944cc19b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6487fec5386448789a8366c68533f627"
I20260807 05:03:45.577936 22541 raft_consensus.cc:3037] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:45.577932 22764 raft_consensus.cc:3037] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:45.578936 22541 raft_consensus.cc:2454] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81e934c56b2e4c9e99163e944cc19b8d in term 1.
I20260807 05:03:45.579038 22764 raft_consensus.cc:2454] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81e934c56b2e4c9e99163e944cc19b8d in term 1.
I20260807 05:03:45.579262 22878 leader_election.cc:302] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6487fec5386448789a8366c68533f627, 81e934c56b2e4c9e99163e944cc19b8d; no voters:
I20260807 05:03:45.579413 23111 raft_consensus.cc:2781] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:45.579645 23111 raft_consensus.cc:686] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 1 LEADER]: Becoming Leader. State: Replica: 81e934c56b2e4c9e99163e944cc19b8d, State: Running, Role: LEADER
I20260807 05:03:45.579942 23111 consensus_queue.cc:237] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } }
I20260807 05:03:45.582971 22303 catalog_manager.cc:5495] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 81e934c56b2e4c9e99163e944cc19b8d (127.25.214.195). New cstate: current_term: 1 leader_uuid: "81e934c56b2e4c9e99163e944cc19b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81e934c56b2e4c9e99163e944cc19b8d" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 44423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 } health_report { overall_health: UNKNOWN } } }
I20260807 05:03:45.604857 23098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.601268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43830 (local address 127.25.214.195:44423)
0807 05:03:45.601419 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.601423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.601439 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:03:45.601573 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.601576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.601641 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.601736 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:45.601999 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.602521 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.603359 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.603587 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.603681 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.603914 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:45.604370 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:45.604493 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.604633 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.604678 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 05:03:45.610757 22541 raft_consensus.cc:1261] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 1 FOLLOWER]: Refusing update from remote peer 81e934c56b2e4c9e99163e944cc19b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:45.610757 22764 raft_consensus.cc:1261] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 1 FOLLOWER]: Refusing update from remote peer 81e934c56b2e4c9e99163e944cc19b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:45.611495 23124 consensus_queue.cc:1035] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6487fec5386448789a8366c68533f627" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 45783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:45.611689 23111 consensus_queue.cc:1035] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59848d1b96a94ef2adf9cd06abbb6179" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:45.622236 23130 mvcc.cc:205] Tried to move back new op lower bound from 7315779688893898752 to 7315779688778014720. Current Snapshot: MvccSnapshot[applied={T|T < 7315779688893898752}]
I20260807 05:03:45.632752 22301 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:45.632993 22301 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:45.635878 22301 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b634f2d3dbf440eda1d6b9ea49e93227: Sending DeleteTablet for 3 replicas of tablet 93d9f801b282423595cdc0508763c5a3
I20260807 05:03:45.636806 22952 tablet_service.cc:1514] Processing DeleteTablet for tablet 93d9f801b282423595cdc0508763c5a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:45 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:43822
I20260807 05:03:45.636907 22512 tablet_service.cc:1514] Processing DeleteTablet for tablet 93d9f801b282423595cdc0508763c5a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:45 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:35626
I20260807 05:03:45.637379 23144 tablet_replica.cc:330] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: stopping tablet replica
I20260807 05:03:45.637689 23145 tablet_replica.cc:330] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627: stopping tablet replica
I20260807 05:03:45.637732 22728 tablet_service.cc:1514] Processing DeleteTablet for tablet 93d9f801b282423595cdc0508763c5a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:45 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:41858
I20260807 05:03:45.637917 23144 raft_consensus.cc:2229] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:03:45.638011 23145 raft_consensus.cc:2229] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:45.638329 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 22402
I20260807 05:03:45.638363 23145 raft_consensus.cc:2258] T 93d9f801b282423595cdc0508763c5a3 P 6487fec5386448789a8366c68533f627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:45.642549 23144 raft_consensus.cc:2258] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:45.643579 23146 tablet_replica.cc:330] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: stopping tablet replica
I20260807 05:03:45.643966 23146 raft_consensus.cc:2229] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:45.644364 23146 raft_consensus.cc:2258] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:45.644747 23144 ts_tablet_manager.cc:1905] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:45.645953 23146 ts_tablet_manager.cc:1905] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:45.647641 23144 ts_tablet_manager.cc:1918] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:45.647832 23144 log.cc:1196] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/93d9f801b282423595cdc0508763c5a3
I20260807 05:03:45.648280 23144 ts_tablet_manager.cc:1939] T 93d9f801b282423595cdc0508763c5a3 P 81e934c56b2e4c9e99163e944cc19b8d: Deleting consensus metadata
I20260807 05:03:45.648590 23146 ts_tablet_manager.cc:1918] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:45.648689 23146 log.cc:1196] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/93d9f801b282423595cdc0508763c5a3
I20260807 05:03:45.649003 23146 ts_tablet_manager.cc:1939] T 93d9f801b282423595cdc0508763c5a3 P 59848d1b96a94ef2adf9cd06abbb6179: Deleting consensus metadata
W20260807 05:03:45.649510 22274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:45783 (error 108)
I20260807 05:03:45.650156 22274 catalog_manager.cc:4841] TS 59848d1b96a94ef2adf9cd06abbb6179 (127.25.214.194:41241): tablet 93d9f801b282423595cdc0508763c5a3 (table test-table [id=25f59910a4164d7e9166eb7613bb79a1]) successfully deleted
I20260807 05:03:45.650229 22278 catalog_manager.cc:4841] TS 81e934c56b2e4c9e99163e944cc19b8d (127.25.214.195:44423): tablet 93d9f801b282423595cdc0508763c5a3 (table test-table [id=25f59910a4164d7e9166eb7613bb79a1]) successfully deleted
I20260807 05:03:45.650638 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 22629
I20260807 05:03:45.650794 23099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.650492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:45783 (local address 127.0.0.1:35642)
0807 05:03:45.650634 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:45.650709 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:45783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 05:03:45.659097 22274 catalog_manager.cc:4584] TS 6487fec5386448789a8366c68533f627 (127.25.214.193:45783): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93d9f801b282423595cdc0508763c5a3: Network error: Client connection negotiation failed: client connection to 127.25.214.193:45783: connect: Connection refused (error 111)
I20260807 05:03:45.667186 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 22855
I20260807 05:03:45.679982 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 22254
2026-08-07T05:03:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2442 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T05:03:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:45Z Disabled control of system clock
I20260807 05:03:45.718988 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33537
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:33537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 05:03:45.833503 23152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:45.833812 23152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:45.833860 23152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:45.837973 23152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:45.838063 23152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:45.838079 23152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:45.838099 23152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:45.838115 23152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:45.843050 23152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:33537
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:45.844292 23152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:45.845712 23152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:45.854421 23167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:45.854540 23171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:45.854511 23152 server_base.cc:1034] running on GCE node
W20260807 05:03:45.854423 23166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:45.855296 23152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:45.856568 23152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:45.857764 23152 hybrid_clock.cc:648] HybridClock initialized: now 1786079025857746 us; error 31 us; skew 500 ppm
I20260807 05:03:45.859822 23152 webserver.cc:460] Webserver started at http://127.25.214.254:39207/ using document root <none> and password file <none>
I20260807 05:03:45.860491 23152 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:45.860562 23152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:45.860785 23152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:45.863034 23152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "37b7b4d8edad45e1b758d8d8b69e63c8"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "06027e27cbc1ae251062636b4938212a"
server_key_iv: "24c0e0b78dfb8917dd0db0a891119a40"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.863621 23152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "37b7b4d8edad45e1b758d8d8b69e63c8"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "06027e27cbc1ae251062636b4938212a"
server_key_iv: "24c0e0b78dfb8917dd0db0a891119a40"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.867832 23152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 05:03:45.870625 23186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:45.871943 23152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 05:03:45.872061 23152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "37b7b4d8edad45e1b758d8d8b69e63c8"
format_stamp: "Formatted at 2026-08-07 05:03:45 on dist-test-slave-lgr5"
server_key: "06027e27cbc1ae251062636b4938212a"
server_key_iv: "24c0e0b78dfb8917dd0db0a891119a40"
server_key_version: "encryptionkey@0"
I20260807 05:03:45.872234 23152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:45.892887 23152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:45.893730 23152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:45.893934 23152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:45.900872 23271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:33537 every 8 connection(s)
I20260807 05:03:45.900877 23152 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:33537
I20260807 05:03:45.901921 23152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:45.905115 23272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:45.905376 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 23152
I20260807 05:03:45.905506 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:45.905799 26459 external_mini_cluster.cc:1428] Setting key 2c28540de1eb840f3a48494163120b00
I20260807 05:03:45.912257 23272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8: Bootstrap starting.
I20260807 05:03:45.914901 23272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:45.915827 23272 log.cc:824] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:45.916478 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:45.907257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55470 (local address 127.25.214.254:33537)
0807 05:03:45.907965 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:45.907985 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:45.908030 (+ 45us) server_negotiation.cc:407] Connection header received
0807 05:03:45.908941 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:45.908965 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:45.909483 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:45.909839 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:45.910288 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.911767 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.912733 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:45.913390 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:45.913562 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:45.914329 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:45.914335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:45.914350 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:45.914836 (+ 486us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:45.914909 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:45.914939 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:45.915041 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:45.915239 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 05:03:45.915516 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":132,"threads_started":1}
I20260807 05:03:45.917834 23272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8: No bootstrap required, opened a new log
I20260807 05:03:45.921382 23272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33537 } }
I20260807 05:03:45.921627 23272 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:45.921686 23272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7b4d8edad45e1b758d8d8b69e63c8, State: Initialized, Role: FOLLOWER
I20260807 05:03:45.922099 23272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33537 } }
I20260807 05:03:45.922233 23272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:45.922298 23272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:45.922397 23272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:45.923346 23272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33537 } }
I20260807 05:03:45.923666 23272 leader_election.cc:302] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37b7b4d8edad45e1b758d8d8b69e63c8; no voters:
I20260807 05:03:45.923986 23272 leader_election.cc:288] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:45.924124 23282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:45.924330 23282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [term 1 LEADER]: Becoming Leader. State: Replica: 37b7b4d8edad45e1b758d8d8b69e63c8, State: Running, Role: LEADER
I20260807 05:03:45.924639 23282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33537 } }
I20260807 05:03:45.925304 23272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:45.926295 23285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37b7b4d8edad45e1b758d8d8b69e63c8. Latest consensus state: current_term: 1 leader_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33537 } } }
I20260807 05:03:45.926437 23285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:45.926716 23284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b7b4d8edad45e1b758d8d8b69e63c8" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33537 } } }
I20260807 05:03:45.926810 23284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:45.926921 23298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:45.930295 23298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:45.935897 23298 catalog_manager.cc:1347] Generated new cluster ID: ee90dd2c2e084f88956595fcb1dc3d6d
I20260807 05:03:45.935974 23298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:45.944486 23298 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:45.945823 23298 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:45.953104 23298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8: Generated new TSK 0
I20260807 05:03:45.953938 23298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:45.960397 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:33537
--builtin_ntp_servers=127.25.214.212:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 05:03:46.079107 23319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:46.079380 23319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:46.079416 23319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:46.083348 23319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:46.083405 23319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:46.083469 23319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:46.088285 23319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:33537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:46.089339 23319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:46.090685 23319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:46.100028 23330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:46.100041 23325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:46.100159 23319 server_base.cc:1034] running on GCE node
W20260807 05:03:46.100041 23327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:46.100654 23319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:46.101251 23319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:46.102427 23319 hybrid_clock.cc:648] HybridClock initialized: now 1786079026102415 us; error 38 us; skew 500 ppm
I20260807 05:03:46.104249 23319 webserver.cc:460] Webserver started at http://127.25.214.193:33561/ using document root <none> and password file <none>
I20260807 05:03:46.104803 23319 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:46.104866 23319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:46.105064 23319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:46.107081 23319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "98b451acd99b4fa68d55e8199565ffb5"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "a163356c5c96d6e6d6b384181880720d"
server_key_iv: "49e3e21e0169630678b6a2afabdc8136"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.107616 23319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "98b451acd99b4fa68d55e8199565ffb5"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "a163356c5c96d6e6d6b384181880720d"
server_key_iv: "49e3e21e0169630678b6a2afabdc8136"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.111104 23319 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 05:03:46.113400 23344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.114564 23319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:03:46.114673 23319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "98b451acd99b4fa68d55e8199565ffb5"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "a163356c5c96d6e6d6b384181880720d"
server_key_iv: "49e3e21e0169630678b6a2afabdc8136"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.114776 23319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:46.140558 23319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:46.141273 23319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:46.141451 23319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:46.142037 23319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:46.143105 23319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:46.143154 23319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.143198 23319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:46.143217 23319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.152308 23319 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:37687
I20260807 05:03:46.152343 23537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:37687 every 8 connection(s)
I20260807 05:03:46.153317 23319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:46.157898 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 23319
I20260807 05:03:46.158030 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:03:46.158413 26459 external_mini_cluster.cc:1428] Setting key 8b491f4676bcfcccfc99ae3232aa5827
I20260807 05:03:46.160413 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:33537
--builtin_ntp_servers=127.25.214.212:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 05:03:46.162971 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.155280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:49451 (local address 127.25.214.254:33537)
0807 05:03:46.155414 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.155418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.156590 (+ 1172us) server_negotiation.cc:407] Connection header received
0807 05:03:46.158038 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.158042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.158110 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.158203 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:46.159182 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.159781 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.161051 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.161340 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.161443 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.162513 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:46.162516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:46.162518 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:46.162531 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:46.162548 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:46.162556 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:46.162617 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.162762 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.162826 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:03:46.163843 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.155689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:33537 (local address 127.25.214.193:49451)
0807 05:03:46.156401 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.156445 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.157797 (+ 1352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.158396 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.158403 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.158518 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:46.159045 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.159060 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.159915 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.159918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.160929 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.160939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.161471 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.161474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.161623 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.162254 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:46.162256 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:46.162298 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:46.162369 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:46.162626 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:46.162636 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:46.162642 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.162755 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.163052 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":125,"threads_started":1}
I20260807 05:03:46.165169 23540 heartbeater.cc:347] Connected to a master server at 127.25.214.254:33537
I20260807 05:03:46.165443 23540 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:46.166036 23540 heartbeater.cc:511] Master 127.25.214.254:33537 requested a full tablet report, sending...
I20260807 05:03:46.167496 23216 ts_manager.cc:194] Registered new tserver with Master: 98b451acd99b4fa68d55e8199565ffb5 (127.25.214.193:37687)
I20260807 05:03:46.168648 23216 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.193:49451
W20260807 05:03:46.274513 23543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:46.274799 23543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:46.274854 23543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:46.278889 23543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:46.278959 23543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:46.279036 23543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:46.283989 23543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:33537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:46.285272 23543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:46.286808 23543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:46.296633 23551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:46.296617 23555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:46.296617 23552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:46.296818 23543 server_base.cc:1034] running on GCE node
I20260807 05:03:46.297397 23543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:46.298029 23543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:46.299192 23543 hybrid_clock.cc:648] HybridClock initialized: now 1786079026299173 us; error 34 us; skew 500 ppm
I20260807 05:03:46.301079 23543 webserver.cc:460] Webserver started at http://127.25.214.194:45023/ using document root <none> and password file <none>
I20260807 05:03:46.301661 23543 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:46.301729 23543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:46.301939 23543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:46.303984 23543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "6aa4e3101e9f41afb424c6b879bc4529"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "4a2fbdb2ba615b0192cc5cbb99d3c6a5"
server_key_iv: "189b476d064ab02ad2f0f366848c4955"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.304606 23543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "6aa4e3101e9f41afb424c6b879bc4529"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "4a2fbdb2ba615b0192cc5cbb99d3c6a5"
server_key_iv: "189b476d064ab02ad2f0f366848c4955"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.308255 23543 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:46.310734 23562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.311888 23543 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:46.312009 23543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "6aa4e3101e9f41afb424c6b879bc4529"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "4a2fbdb2ba615b0192cc5cbb99d3c6a5"
server_key_iv: "189b476d064ab02ad2f0f366848c4955"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.312142 23543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:46.325639 23543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:46.326407 23543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:46.326571 23543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:46.327132 23543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:46.328037 23543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:46.328111 23543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.328174 23543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:46.328207 23543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.336429 23543 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:46559
I20260807 05:03:46.336534 23746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:46559 every 8 connection(s)
I20260807 05:03:46.337301 23543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:46.337648 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 23543
I20260807 05:03:46.337779 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:03:46.338145 26459 external_mini_cluster.cc:1428] Setting key 60059798904b712bb8e67691b3f9ec8f
I20260807 05:03:46.340268 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:33537
--builtin_ntp_servers=127.25.214.212:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 05:03:46.346517 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.339062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:37155 (local address 127.25.214.254:33537)
0807 05:03:46.339204 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.339209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.340396 (+ 1187us) server_negotiation.cc:407] Connection header received
0807 05:03:46.341820 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.341823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.341887 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.341961 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:46.342898 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.343431 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.344632 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.344846 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.344943 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.346021 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:46.346024 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:46.346027 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:46.346042 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:46.346061 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:46.346069 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:46.346150 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.346307 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.346371 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:03:46.347335 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.339526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:33537 (local address 127.25.214.194:37155)
0807 05:03:46.340244 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.340295 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.341610 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.342153 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.342161 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.342247 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:46.342740 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.342752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.343553 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.343557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.344497 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.344507 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.344997 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.345001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.345170 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.345762 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:46.345763 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:46.345803 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:46.345868 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:46.346168 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:46.346179 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:46.346185 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.346291 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.346575 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260807 05:03:46.348575 23747 heartbeater.cc:347] Connected to a master server at 127.25.214.254:33537
I20260807 05:03:46.348794 23747 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:46.349313 23747 heartbeater.cc:511] Master 127.25.214.254:33537 requested a full tablet report, sending...
I20260807 05:03:46.350406 23216 ts_manager.cc:194] Registered new tserver with Master: 6aa4e3101e9f41afb424c6b879bc4529 (127.25.214.194:46559)
I20260807 05:03:46.350983 23216 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.194:37155
W20260807 05:03:46.457116 23752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:46.457403 23752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:46.457458 23752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:46.461585 23752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:46.461655 23752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:46.461732 23752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:46.466703 23752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:33537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:46.467928 23752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:46.469417 23752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:46.479255 23766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:46.479255 23763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:46.479349 23771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:46.479745 23752 server_base.cc:1034] running on GCE node
I20260807 05:03:46.480190 23752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:46.480834 23752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:46.482057 23752 hybrid_clock.cc:648] HybridClock initialized: now 1786079026482038 us; error 30 us; skew 500 ppm
I20260807 05:03:46.484062 23752 webserver.cc:460] Webserver started at http://127.25.214.195:34779/ using document root <none> and password file <none>
I20260807 05:03:46.484720 23752 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:46.484793 23752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:46.485018 23752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:46.487293 23752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "b414763ce58f41448f189fe6afd1c509"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "287a56704e3d38a0700c1fd3ff92cf07"
server_key_iv: "701d81de9cc18449f2a6c5c85be0e10d"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.487905 23752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "b414763ce58f41448f189fe6afd1c509"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "287a56704e3d38a0700c1fd3ff92cf07"
server_key_iv: "701d81de9cc18449f2a6c5c85be0e10d"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.491962 23752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260807 05:03:46.494819 23781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.496114 23752 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:46.496249 23752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "b414763ce58f41448f189fe6afd1c509"
format_stamp: "Formatted at 2026-08-07 05:03:46 on dist-test-slave-lgr5"
server_key: "287a56704e3d38a0700c1fd3ff92cf07"
server_key_iv: "701d81de9cc18449f2a6c5c85be0e10d"
server_key_version: "encryptionkey@0"
I20260807 05:03:46.496385 23752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:46.516532 23752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:46.517377 23752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:46.517601 23752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:46.518282 23752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:46.519387 23752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:46.519455 23752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.519519 23752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:46.519557 23752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:46.529868 23752 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:45701
I20260807 05:03:46.529892 23973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:45701 every 8 connection(s)
I20260807 05:03:46.530805 23752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:46.537915 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 23752
I20260807 05:03:46.538049 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:03:46.538379 26459 external_mini_cluster.cc:1428] Setting key 02507c5a6417128a5a2635f9d5b8e52d
I20260807 05:03:46.540340 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.532690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:36883 (local address 127.25.214.254:33537)
0807 05:03:46.532832 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.532836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.533862 (+ 1026us) server_negotiation.cc:407] Connection header received
0807 05:03:46.535280 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.535283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.535344 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.535425 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:46.536384 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.536909 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.538255 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.538522 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.538613 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.539843 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:46.539847 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:46.539849 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:46.539861 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:46.539882 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:46.539891 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:46.539950 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.540168 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.540222 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 05:03:46.541289 23980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.533088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:33537 (local address 127.25.214.195:36883)
0807 05:03:46.533716 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.533756 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.535074 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.535605 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.535611 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.535695 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:46.536236 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.536254 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.537039 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.537042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.538127 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.538140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.538689 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.538694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.538855 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.539548 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:46.539550 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:46.539606 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:46.539682 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:46.539977 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:46.539986 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:46.539992 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.540172 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.540479 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
I20260807 05:03:46.542321 23976 heartbeater.cc:347] Connected to a master server at 127.25.214.254:33537
I20260807 05:03:46.542546 23976 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:46.543056 23976 heartbeater.cc:511] Master 127.25.214.254:33537 requested a full tablet report, sending...
I20260807 05:03:46.543999 23216 ts_manager.cc:194] Registered new tserver with Master: b414763ce58f41448f189fe6afd1c509 (127.25.214.195:45701)
I20260807 05:03:46.544590 23216 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.195:36883
I20260807 05:03:46.552489 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:46.557876 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.554346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55484 (local address 127.25.214.254:33537)
0807 05:03:46.554537 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.554542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.554624 (+ 82us) server_negotiation.cc:407] Connection header received
0807 05:03:46.554723 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.554725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.554765 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.554830 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:46.555043 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.555561 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.556363 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.556597 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.556676 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.557467 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:46.557470 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:46.557472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:46.557484 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:46.557503 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:46.557511 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:46.557614 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.557691 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.557727 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 05:03:46.560729 23216 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:46.563822 23216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:46.579178 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.573049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:46559 (local address 127.0.0.1:49180)
0807 05:03:46.573416 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.573471 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.573612 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.575290 (+ 1678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.575293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.575311 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:46.575388 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.575394 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.576698 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.576701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.577822 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.577830 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.578627 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.578630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.578741 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.578778 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.578891 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.579017 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":106,"threads_started":1}
I20260807 05:03:46.579348 23995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.573201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49180 (local address 127.25.214.194:46559)
0807 05:03:46.574810 (+ 1609us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.574820 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.574843 (+ 23us) server_negotiation.cc:407] Connection header received
0807 05:03:46.574915 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.574920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.575115 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.575341 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:46.575481 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.576586 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.577961 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.578500 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.578621 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.578816 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.579095 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.579201 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1508,"thread_start_us":128,"threads_started":1}
I20260807 05:03:46.579401 23998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.573284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:37687 (local address 127.0.0.1:38366)
0807 05:03:46.574125 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.574139 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.574230 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.574752 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.574758 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.574780 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:46.574914 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.574921 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.576331 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.576334 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.577601 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.577612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.578901 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.578904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.579018 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.579102 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.579176 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.579246 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"mutex_wait_us":50,"thread_start_us":94,"threads_started":1}
I20260807 05:03:46.579857 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.573915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38366 (local address 127.25.214.193:37687)
0807 05:03:46.574305 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.574318 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.574343 (+ 25us) server_negotiation.cc:407] Connection header received
0807 05:03:46.574421 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.574427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.574598 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.574740 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:46.575045 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.576224 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.577723 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.578541 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.578673 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.578851 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.579580 (+ 729us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.579677 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":88,"threads_started":1}
I20260807 05:03:46.580021 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.573833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:45701 (local address 127.0.0.1:58692)
0807 05:03:46.574451 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.574464 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.574560 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.574993 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.574997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.575016 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:46.575109 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.575116 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.576566 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.576570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.577790 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.577802 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.578973 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.578976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.579128 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.579146 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.579201 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.579837 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":36,"thread_start_us":91,"threads_started":1}
I20260807 05:03:46.580747 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.574002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58692 (local address 127.25.214.195:45701)
0807 05:03:46.574423 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.574434 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.574553 (+ 119us) server_negotiation.cc:407] Connection header received
0807 05:03:46.574668 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.574673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.574857 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.575002 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:46.575204 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.576416 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.577932 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.578674 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.578779 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.578912 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.580482 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.580588 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":105,"threads_started":1}
I20260807 05:03:46.582405 23633 tablet_service.cc:1467] Processing CreateTablet for tablet 860f235801b545d2907ca0a900773670 (DEFAULT_TABLE table=test-table [id=0541922c524640c9a9565fdfc5b40269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:46.583405 23633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 860f235801b545d2907ca0a900773670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:46.583357 23862 tablet_service.cc:1467] Processing CreateTablet for tablet 860f235801b545d2907ca0a900773670 (DEFAULT_TABLE table=test-table [id=0541922c524640c9a9565fdfc5b40269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:46.583357 23430 tablet_service.cc:1467] Processing CreateTablet for tablet 860f235801b545d2907ca0a900773670 (DEFAULT_TABLE table=test-table [id=0541922c524640c9a9565fdfc5b40269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:46.584400 23430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 860f235801b545d2907ca0a900773670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:46.584400 23862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 860f235801b545d2907ca0a900773670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:46.590001 24002 tablet_bootstrap.cc:492] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Bootstrap starting.
I20260807 05:03:46.591928 24003 tablet_bootstrap.cc:492] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: Bootstrap starting.
I20260807 05:03:46.592152 24004 tablet_bootstrap.cc:492] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Bootstrap starting.
I20260807 05:03:46.592598 24002 tablet_bootstrap.cc:654] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:46.593453 24002 log.cc:824] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:46.594259 24004 tablet_bootstrap.cc:654] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:46.594259 24003 tablet_bootstrap.cc:654] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:46.595140 24003 log.cc:824] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:46.595140 24004 log.cc:824] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:46.595584 24002 tablet_bootstrap.cc:492] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: No bootstrap required, opened a new log
I20260807 05:03:46.595799 24002 ts_tablet_manager.cc:1397] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:03:46.597235 24003 tablet_bootstrap.cc:492] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: No bootstrap required, opened a new log
I20260807 05:03:46.597235 24004 tablet_bootstrap.cc:492] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: No bootstrap required, opened a new log
I20260807 05:03:46.597435 24003 ts_tablet_manager.cc:1397] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:03:46.597435 24004 ts_tablet_manager.cc:1397] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 05:03:46.599164 24002 raft_consensus.cc:348] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.599452 24002 raft_consensus.cc:374] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:46.599516 24002 raft_consensus.cc:729] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa4e3101e9f41afb424c6b879bc4529, State: Initialized, Role: FOLLOWER
I20260807 05:03:46.599985 24002 consensus_queue.cc:260] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.601099 23747 heartbeater.cc:503] Master 127.25.214.254:33537 was elected leader, sending a full tablet report...
I20260807 05:03:46.601610 24004 raft_consensus.cc:348] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.601611 24003 raft_consensus.cc:348] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.601884 24003 raft_consensus.cc:374] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:46.601884 24004 raft_consensus.cc:374] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:46.601944 24003 raft_consensus.cc:729] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b451acd99b4fa68d55e8199565ffb5, State: Initialized, Role: FOLLOWER
I20260807 05:03:46.601944 24004 raft_consensus.cc:729] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b414763ce58f41448f189fe6afd1c509, State: Initialized, Role: FOLLOWER
I20260807 05:03:46.602458 24002 ts_tablet_manager.cc:1428] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 05:03:46.602435 24003 consensus_queue.cc:260] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.602437 24004 consensus_queue.cc:260] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.603180 23540 heartbeater.cc:503] Master 127.25.214.254:33537 was elected leader, sending a full tablet report...
I20260807 05:03:46.603483 24003 ts_tablet_manager.cc:1428] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:03:46.603483 24004 ts_tablet_manager.cc:1428] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:03:46.603811 23976 heartbeater.cc:503] Master 127.25.214.254:33537 was elected leader, sending a full tablet report...
I20260807 05:03:46.630671 24013 raft_consensus.cc:482] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:46.630898 24013 raft_consensus.cc:504] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.632058 24013 leader_election.cc:288] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6aa4e3101e9f41afb424c6b879bc4529 (127.25.214.194:46559), 98b451acd99b4fa68d55e8199565ffb5 (127.25.214.193:37687)
I20260807 05:03:46.635905 23980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.632347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:46559 (local address 127.25.214.195:41153)
0807 05:03:46.632474 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.632490 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.632586 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.632847 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.632851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.632870 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:46.632971 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.632976 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.633815 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.633819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.634789 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.634800 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.635508 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.635512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.635606 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.635631 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.635704 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.635764 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":34}
I20260807 05:03:46.635922 23995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.632452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:41153 (local address 127.25.214.194:46559)
0807 05:03:46.632586 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.632590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.632607 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:03:46.632670 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.632673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.632729 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.632813 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:46.633067 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.633713 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.634908 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.635399 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.635490 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.635528 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.635726 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.635799 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 05:03:46.636008 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.632452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:58281 (local address 127.25.214.193:37687)
0807 05:03:46.632586 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.632590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.632976 (+ 386us) server_negotiation.cc:407] Connection header received
0807 05:03:46.633112 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.633115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.633162 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.633219 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:46.633483 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.634074 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.635115 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.635512 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.635623 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.635666 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.635826 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.635900 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:03:46.636418 24014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.632371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:37687 (local address 127.25.214.195:58281)
0807 05:03:46.632868 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.632882 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:46.632994 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:46.633245 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:46.633249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:46.633266 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:46.633391 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.633397 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.634173 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.634175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.634995 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:46.635006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.635623 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.635626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:46.635708 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.635732 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 05:03:46.635802 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 05:03:46.635864 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":132,"thread_start_us":136,"threads_started":1}
I20260807 05:03:46.636664 23664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "860f235801b545d2907ca0a900773670" candidate_uuid: "b414763ce58f41448f189fe6afd1c509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa4e3101e9f41afb424c6b879bc4529" is_pre_election: true
I20260807 05:03:46.636978 23664 raft_consensus.cc:2454] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b414763ce58f41448f189fe6afd1c509 in term 0.
I20260807 05:03:46.637060 23458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "860f235801b545d2907ca0a900773670" candidate_uuid: "b414763ce58f41448f189fe6afd1c509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b451acd99b4fa68d55e8199565ffb5" is_pre_election: true
I20260807 05:03:46.637373 23458 raft_consensus.cc:2454] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b414763ce58f41448f189fe6afd1c509 in term 0.
I20260807 05:03:46.637480 23782 leader_election.cc:302] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aa4e3101e9f41afb424c6b879bc4529, b414763ce58f41448f189fe6afd1c509; no voters:
I20260807 05:03:46.637765 24013 raft_consensus.cc:2781] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:46.637862 24013 raft_consensus.cc:482] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:46.637920 24013 raft_consensus.cc:3037] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:46.638964 24013 raft_consensus.cc:504] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.639313 24013 leader_election.cc:288] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [CANDIDATE]: Term 1 election: Requested vote from peers 6aa4e3101e9f41afb424c6b879bc4529 (127.25.214.194:46559), 98b451acd99b4fa68d55e8199565ffb5 (127.25.214.193:37687)
I20260807 05:03:46.639642 23458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "860f235801b545d2907ca0a900773670" candidate_uuid: "b414763ce58f41448f189fe6afd1c509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b451acd99b4fa68d55e8199565ffb5"
I20260807 05:03:46.639667 23664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "860f235801b545d2907ca0a900773670" candidate_uuid: "b414763ce58f41448f189fe6afd1c509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa4e3101e9f41afb424c6b879bc4529"
I20260807 05:03:46.639775 23664 raft_consensus.cc:3037] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:46.639773 23458 raft_consensus.cc:3037] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:46.640870 23664 raft_consensus.cc:2454] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b414763ce58f41448f189fe6afd1c509 in term 1.
I20260807 05:03:46.640906 23458 raft_consensus.cc:2454] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b414763ce58f41448f189fe6afd1c509 in term 1.
I20260807 05:03:46.641142 23782 leader_election.cc:302] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aa4e3101e9f41afb424c6b879bc4529, b414763ce58f41448f189fe6afd1c509; no voters:
I20260807 05:03:46.641304 24013 raft_consensus.cc:2781] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:46.641512 24013 raft_consensus.cc:686] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 1 LEADER]: Becoming Leader. State: Replica: b414763ce58f41448f189fe6afd1c509, State: Running, Role: LEADER
I20260807 05:03:46.641848 24013 consensus_queue.cc:237] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } }
I20260807 05:03:46.645018 23216 catalog_manager.cc:5495] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 reported cstate change: term changed from 0 to 1, leader changed from <none> to b414763ce58f41448f189fe6afd1c509 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "b414763ce58f41448f189fe6afd1c509" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b414763ce58f41448f189fe6afd1c509" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 } health_report { overall_health: UNKNOWN } } }
W20260807 05:03:46.654554 23541 tablet.cc:2369] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:03:46.663903 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.660634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58702 (local address 127.25.214.195:45701)
0807 05:03:46.660751 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:46.660755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:46.660768 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:03:46.660842 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:46.660844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:46.660900 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:46.660987 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:46.661189 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.661706 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.662598 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:46.662804 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:46.662884 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:46.663155 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:46.663560 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:46.663665 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:46.663738 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 05:03:46.663769 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:03:46.669883 23458 raft_consensus.cc:1261] T 860f235801b545d2907ca0a900773670 P 98b451acd99b4fa68d55e8199565ffb5 [term 1 FOLLOWER]: Refusing update from remote peer b414763ce58f41448f189fe6afd1c509: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:46.669888 23664 raft_consensus.cc:1261] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 1 FOLLOWER]: Refusing update from remote peer b414763ce58f41448f189fe6afd1c509: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:46.670531 24013 consensus_queue.cc:1035] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b451acd99b4fa68d55e8199565ffb5" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:46.670779 24015 consensus_queue.cc:1035] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa4e3101e9f41afb424c6b879bc4529" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:46.679186 24021 mvcc.cc:205] Tried to move back new op lower bound from 7315779693232078848 to 7315779693127868416. Current Snapshot: MvccSnapshot[applied={T|T < 7315779693232078848}]
I20260807 05:03:46.680737 24022 mvcc.cc:205] Tried to move back new op lower bound from 7315779693232078848 to 7315779693127868416. Current Snapshot: MvccSnapshot[applied={T|T < 7315779693232078848}]
I20260807 05:03:46.687625 23216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:46.687803 23216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:46.690241 23216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37b7b4d8edad45e1b758d8d8b69e63c8: Sending DeleteTablet for 3 replicas of tablet 860f235801b545d2907ca0a900773670
I20260807 05:03:46.691088 23430 tablet_service.cc:1514] Processing DeleteTablet for tablet 860f235801b545d2907ca0a900773670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:46 UTC) from {username='slave'} at 127.0.0.1:38366
I20260807 05:03:46.691150 23633 tablet_service.cc:1514] Processing DeleteTablet for tablet 860f235801b545d2907ca0a900773670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:46 UTC) from {username='slave'} at 127.0.0.1:49180
I20260807 05:03:46.691632 23862 tablet_service.cc:1514] Processing DeleteTablet for tablet 860f235801b545d2907ca0a900773670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:46 UTC) from {username='slave'} at 127.0.0.1:58692
I20260807 05:03:46.691730 24034 tablet_replica.cc:330] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: stopping tablet replica
I20260807 05:03:46.691912 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 23319
I20260807 05:03:46.709882 24035 tablet_replica.cc:330] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: stopping tablet replica
I20260807 05:03:46.710294 24035 raft_consensus.cc:2229] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:03:46.710737 24035 raft_consensus.cc:2258] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:46.714731 24035 ts_tablet_manager.cc:1905] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:46.717617 24035 ts_tablet_manager.cc:1918] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:46.717706 24035 log.cc:1196] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/860f235801b545d2907ca0a900773670
I20260807 05:03:46.717967 24035 ts_tablet_manager.cc:1939] T 860f235801b545d2907ca0a900773670 P b414763ce58f41448f189fe6afd1c509: Deleting consensus metadata
I20260807 05:03:46.719936 23187 catalog_manager.cc:4841] TS b414763ce58f41448f189fe6afd1c509 (127.25.214.195:45701): tablet 860f235801b545d2907ca0a900773670 (table test-table [id=0541922c524640c9a9565fdfc5b40269]) successfully deleted
I20260807 05:03:46.725391 24034 raft_consensus.cc:2229] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:46.725878 24034 raft_consensus.cc:2258] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:46.727725 24034 ts_tablet_manager.cc:1905] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:46.730504 24034 ts_tablet_manager.cc:1918] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:46.730618 24034 log.cc:1196] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/860f235801b545d2907ca0a900773670
I20260807 05:03:46.730896 24034 ts_tablet_manager.cc:1939] T 860f235801b545d2907ca0a900773670 P 6aa4e3101e9f41afb424c6b879bc4529: Deleting consensus metadata
I20260807 05:03:46.732262 23187 catalog_manager.cc:4841] TS 6aa4e3101e9f41afb424c6b879bc4529 (127.25.214.194:46559): tablet 860f235801b545d2907ca0a900773670 (table test-table [id=0541922c524640c9a9565fdfc5b40269]) successfully deleted
W20260807 05:03:46.733031 23191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:37687 (error 108)
I20260807 05:03:46.733794 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 23543
I20260807 05:03:46.734179 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:46.733835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:37687 (local address 127.0.0.1:38382)
0807 05:03:46.734024 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:46.734091 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:37687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260807 05:03:46.746312 23191 catalog_manager.cc:4584] TS 98b451acd99b4fa68d55e8199565ffb5 (127.25.214.193:37687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 860f235801b545d2907ca0a900773670: Network error: Client connection negotiation failed: client connection to 127.25.214.193:37687: connect: Connection refused (error 111)
I20260807 05:03:46.752682 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 23752
I20260807 05:03:46.763270 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 23152
2026-08-07T05:03:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1082 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:46 dist-test-slave-lgr5 krb5kdc[24040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:46 dist-test-slave-lgr5 krb5kdc[24040](info): set up 2 sockets
Aug 07 05:03:46 dist-test-slave-lgr5 krb5kdc[24040](info): commencing operation
krb5kdc: starting...
W20260807 05:03:47.911713 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:47 dist-test-slave-lgr5 krb5kdc[24040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:03:48.039855 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43151
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:48.157161 24061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:48.157449 24061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:48.157491 24061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:48.161419 24061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:48.161477 24061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:48.161499 24061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:48.161517 24061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:48.161533 24061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:48.166656 24061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:48.167661 24061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:48.168715 24061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:48.177098 24073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:48.177158 24061 server_base.cc:1034] running on GCE node
W20260807 05:03:48.177103 24067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:48.177135 24068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:48.177925 24061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:48.178963 24061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:48.180142 24061 hybrid_clock.cc:648] HybridClock initialized: now 1786079028180130 us; error 27 us; skew 500 ppm
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:48.186575 24061 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:03:48.187464 24061 webserver.cc:460] Webserver started at http://127.25.214.254:40987/ using document root <none> and password file <none>
I20260807 05:03:48.188014 24061 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:48.188072 24061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:48.188300 24061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:48.190305 24061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "24d00f254a7c439d96018d31fe2f9113"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "d5df3e3abbaed3293493a9be33d11c09"
server_key_iv: "3c58904789d6b63d8e710e22dd968f99"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.190858 24061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "24d00f254a7c439d96018d31fe2f9113"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "d5df3e3abbaed3293493a9be33d11c09"
server_key_iv: "3c58904789d6b63d8e710e22dd968f99"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.194398 24061 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 05:03:48.196648 24082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.197794 24061 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:03:48.197908 24061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "24d00f254a7c439d96018d31fe2f9113"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "d5df3e3abbaed3293493a9be33d11c09"
server_key_iv: "3c58904789d6b63d8e710e22dd968f99"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.198011 24061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:48.223309 24061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:48.229862 24061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:48.230091 24061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:48.243330 24061 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43151
I20260807 05:03:48.243372 24167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43151 every 8 connection(s)
I20260807 05:03:48.244721 24061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:48.248574 24168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:48.248562 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 24061
I20260807 05:03:48.248714 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:48.249053 26459 external_mini_cluster.cc:1428] Setting key fff514109184f9031eb9839419fb3623
I20260807 05:03:48.256261 24168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: Bootstrap starting.
I20260807 05:03:48.259076 24168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:48.260035 24168 log.cc:824] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: Log is configured to *not* fsync() on all Append() calls
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:48.262806 24168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: No bootstrap required, opened a new log
I20260807 05:03:48.267148 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.250583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.25.214.254:43151)
0807 05:03:48.251023 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:48.251039 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:48.251077 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:03:48.251713 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:48.251736 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:48.252208 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:48.252564 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:48.253433 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.254920 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.257107 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.257832 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.258002 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:48.261206 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:48.261213 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:48.261231 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:48.261262 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:48.263251 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:48.263754 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:48.263760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:48.263767 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:48.263925 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:48.264256 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:48.264259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:48.264261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:48.264791 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:48.265001 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:48.265815 (+ 814us) server_negotiation.cc:299] Negotiation successful
0807 05:03:48.266136 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":149,"threads_started":1}
I20260807 05:03:48.267537 24168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d00f254a7c439d96018d31fe2f9113" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43151 } }
I20260807 05:03:48.267825 24168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:48.267884 24168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d00f254a7c439d96018d31fe2f9113, State: Initialized, Role: FOLLOWER
I20260807 05:03:48.268365 24168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d00f254a7c439d96018d31fe2f9113" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43151 } }
I20260807 05:03:48.268530 24168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:48.268584 24168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:48.268662 24168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:48.269805 24168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d00f254a7c439d96018d31fe2f9113" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43151 } }
I20260807 05:03:48.270165 24168 leader_election.cc:302] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24d00f254a7c439d96018d31fe2f9113; no voters:
I20260807 05:03:48.270515 24168 leader_election.cc:288] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:48.270726 24174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:48.270984 24174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [term 1 LEADER]: Becoming Leader. State: Replica: 24d00f254a7c439d96018d31fe2f9113, State: Running, Role: LEADER
I20260807 05:03:48.271366 24174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d00f254a7c439d96018d31fe2f9113" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43151 } }
I20260807 05:03:48.271816 24168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:48.274585 24180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24d00f254a7c439d96018d31fe2f9113. Latest consensus state: current_term: 1 leader_uuid: "24d00f254a7c439d96018d31fe2f9113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d00f254a7c439d96018d31fe2f9113" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43151 } } }
I20260807 05:03:48.274674 24180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:48.274339 24176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24d00f254a7c439d96018d31fe2f9113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d00f254a7c439d96018d31fe2f9113" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43151 } } }
I20260807 05:03:48.274871 24176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113 [sys.catalog]: This master's current role is: LEADER
W20260807 05:03:48.276804 24201 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:03:48.276897 24201 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:03:48.276984 24205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:48.277902 24205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:48.284411 24205 catalog_manager.cc:1347] Generated new cluster ID: 32ea420553294fb2a98270017b9f0fb0
I20260807 05:03:48.284536 24205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:48.305985 24205 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:48.306969 24205 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:48.318883 24205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: Generated new TSK 0
I20260807 05:03:48.319617 24205 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.214.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
Entry for principal kudu/127.25.214.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab.
I20260807 05:03:48.349167 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43151
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:48.461603 24211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:48.461889 24211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:48.461951 24211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:48.466037 24211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:48.466101 24211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:48.466185 24211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:48.471664 24211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.193.keytab
--principal=kudu/127.25.214.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:48.473026 24211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:48.474283 24211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:48.484786 24219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:48.484809 24221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:48.484838 24223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:48.484966 24211 server_base.cc:1034] running on GCE node
I20260807 05:03:48.485477 24211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:48.486160 24211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:48.487353 24211 hybrid_clock.cc:648] HybridClock initialized: now 1786079028487332 us; error 34 us; skew 500 ppm
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:48.490123 24211 init.cc:377] Logged in from keytab as kudu/127.25.214.193@KRBTEST.COM (short username kudu)
I20260807 05:03:48.491035 24211 webserver.cc:460] Webserver started at http://127.25.214.193:39407/ using document root <none> and password file <none>
I20260807 05:03:48.491576 24211 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:48.491632 24211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:48.491806 24211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:48.493960 24211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "d517969802b94d8894a945716fe56622"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "0b4a685c95cc7f7ffb6fabef0d5fbba9"
server_key_iv: "f8341eb260bbe30c271ccf7f9060b8a5"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.494489 24211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "d517969802b94d8894a945716fe56622"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "0b4a685c95cc7f7ffb6fabef0d5fbba9"
server_key_iv: "f8341eb260bbe30c271ccf7f9060b8a5"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.498277 24211 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:03:48.500852 24232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.502147 24211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:03:48.502274 24211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "d517969802b94d8894a945716fe56622"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "0b4a685c95cc7f7ffb6fabef0d5fbba9"
server_key_iv: "f8341eb260bbe30c271ccf7f9060b8a5"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.502394 24211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:48.534858 24211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:48.537883 24211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:48.538055 24211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:48.538646 24211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:48.539490 24211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:48.539543 24211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.539584 24211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:48.539605 24211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.548281 24211 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:42263
I20260807 05:03:48.548318 24408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:42263 every 8 connection(s)
I20260807 05:03:48.549220 24211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:48.557261 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 24211
I20260807 05:03:48.557411 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:03:48.557736 26459 external_mini_cluster.cc:1428] Setting key 21604276bfe65555d14581c527759183
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.193@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:48.562965 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.551061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:45443 (local address 127.25.214.254:43151)
0807 05:03:48.551204 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:48.551207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:48.552039 (+ 832us) server_negotiation.cc:407] Connection header received
0807 05:03:48.553397 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:48.553401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:48.553472 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:48.553549 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:48.554724 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.555278 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.556453 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.556683 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.556776 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:48.559501 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:48.559506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:48.559509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:48.559536 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:48.560985 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:48.561497 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:48.561500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:48.561501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:48.561583 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:48.561899 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:48.561902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:48.561904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:48.562090 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:48.562180 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:48.562667 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 05:03:48.562798 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 05:03:48.563764 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.551432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43151 (local address 127.25.214.193:45443)
0807 05:03:48.551886 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:48.551929 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:48.553192 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:48.553746 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:48.553753 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:48.554102 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:48.554582 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:48.554595 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.555399 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.555401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:48.556330 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:48.556341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.556831 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.556835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:48.557008 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:48.557653 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:48.557670 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:48.559334 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:48.561104 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:48.561109 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:48.561121 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:48.561370 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:48.561671 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:48.561673 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:48.561674 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:48.561807 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:48.562190 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:48.562197 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:48.562441 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 05:03:48.562610 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 05:03:48.562933 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":123,"threads_started":1}
I20260807 05:03:48.564992 24410 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43151
I20260807 05:03:48.565222 24410 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:48.565698 24410 heartbeater.cc:511] Master 127.25.214.254:43151 requested a full tablet report, sending...
I20260807 05:03:48.567327 24113 ts_manager.cc:194] Registered new tserver with Master: d517969802b94d8894a945716fe56622 (127.25.214.193:42263)
WARNING: no policy specified for kudu/127.25.214.194@KRBTEST.COM; defaulting to no policy
I20260807 05:03:48.568621 24113 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.193@KRBTEST.COM'} at 127.25.214.193:45443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
Entry for principal kudu/127.25.214.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab.
I20260807 05:03:48.585422 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43151
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:48.698501 24415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:48.698745 24415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:48.698787 24415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:48.703050 24415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:48.703111 24415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:48.703167 24415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:48.708436 24415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.194.keytab
--principal=kudu/127.25.214.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:48.709403 24415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:48.710382 24415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:48.719966 24424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:48.719964 24430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:48.719960 24427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:48.720044 24415 server_base.cc:1034] running on GCE node
I20260807 05:03:48.720710 24415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:48.721410 24415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:48.722600 24415 hybrid_clock.cc:648] HybridClock initialized: now 1786079028722569 us; error 41 us; skew 500 ppm
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:48.725524 24415 init.cc:377] Logged in from keytab as kudu/127.25.214.194@KRBTEST.COM (short username kudu)
I20260807 05:03:48.726486 24415 webserver.cc:460] Webserver started at http://127.25.214.194:38371/ using document root <none> and password file <none>
I20260807 05:03:48.727054 24415 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:48.727128 24415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:48.727365 24415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:48.729543 24415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "c29405002892404e92154c12536c5598"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "ca4344a745e3912779145b59c0cfe347"
server_key_iv: "ba7958d3695f6608eb6a04fa889b1a39"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.730118 24415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "c29405002892404e92154c12536c5598"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "ca4344a745e3912779145b59c0cfe347"
server_key_iv: "ba7958d3695f6608eb6a04fa889b1a39"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.734030 24415 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:03:48.736581 24440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.737874 24415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:48.738008 24415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "c29405002892404e92154c12536c5598"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "ca4344a745e3912779145b59c0cfe347"
server_key_iv: "ba7958d3695f6608eb6a04fa889b1a39"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.738109 24415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:48.750164 24415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:48.753044 24415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:48.753226 24415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:48.753811 24415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:48.754647 24415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:48.754695 24415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.754748 24415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:48.754774 24415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.763396 24415 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:41129
I20260807 05:03:48.763413 24608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:41129 every 8 connection(s)
I20260807 05:03:48.764328 24415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:48.772507 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 24415
I20260807 05:03:48.772650 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:03:48.772965 26459 external_mini_cluster.cc:1428] Setting key e0696e8d6fc9bb0d533e7173eae5c96d
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.194@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:48.778671 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.766275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:38891 (local address 127.25.214.254:43151)
0807 05:03:48.766431 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:48.766435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:48.767155 (+ 720us) server_negotiation.cc:407] Connection header received
0807 05:03:48.768585 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:48.768588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:48.768648 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:48.768729 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:48.769921 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.770467 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.771663 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.771943 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.772037 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:48.774961 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:48.774965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:48.774968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:48.774998 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:48.776410 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:48.777013 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:48.777016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:48.777018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:48.777102 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:48.777439 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:48.777442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:48.777444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:48.777656 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:48.777750 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:48.778411 (+ 661us) server_negotiation.cc:299] Negotiation successful
0807 05:03:48.778540 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 05:03:48.779923 24614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.766537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43151 (local address 127.25.214.194:38891)
0807 05:03:48.767002 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:48.767046 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:48.768367 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:48.768906 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:48.768912 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:48.769270 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:48.769773 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:48.769788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.770597 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.770600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:48.771522 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:48.771532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.772127 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.772132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:48.772330 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:48.773007 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:48.773026 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:48.774788 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:48.776532 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:48.776539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:48.776558 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:48.776915 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:48.777186 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:48.777189 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:48.777191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:48.777343 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:48.777764 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:48.777771 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:48.778124 (+ 353us) client_negotiation.cc:769] Sending connection context
0807 05:03:48.778346 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 05:03:48.778727 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":126,"threads_started":1}
I20260807 05:03:48.781224 24609 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43151
I20260807 05:03:48.781527 24609 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:48.782213 24609 heartbeater.cc:511] Master 127.25.214.254:43151 requested a full tablet report, sending...
I20260807 05:03:48.783424 24113 ts_manager.cc:194] Registered new tserver with Master: c29405002892404e92154c12536c5598 (127.25.214.194:41129)
WARNING: no policy specified for kudu/127.25.214.195@KRBTEST.COM; defaulting to no policy
I20260807 05:03:48.784049 24113 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.194@KRBTEST.COM'} at 127.25.214.194:38891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
Entry for principal kudu/127.25.214.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab.
I20260807 05:03:48.801263 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43151
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:48.915882 24618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:48.916276 24618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:48.916343 24618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:48.920390 24618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:48.920449 24618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:48.920507 24618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:48.925937 24618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.195.keytab
--principal=kudu/127.25.214.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:48.927099 24618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:48.928193 24618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:48.937633 24629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:48.937721 24618 server_base.cc:1034] running on GCE node
W20260807 05:03:48.937650 24625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:48.937645 24624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:48.938272 24618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:48.938863 24618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:48.940027 24618 hybrid_clock.cc:648] HybridClock initialized: now 1786079028940014 us; error 25 us; skew 500 ppm
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:48.942703 24618 init.cc:377] Logged in from keytab as kudu/127.25.214.195@KRBTEST.COM (short username kudu)
I20260807 05:03:48.943564 24618 webserver.cc:460] Webserver started at http://127.25.214.195:44947/ using document root <none> and password file <none>
I20260807 05:03:48.944181 24618 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:48.944254 24618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:48.944438 24618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:48.946646 24618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "53acb7480a6c4e13be1f27d3da724a28"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "52cf6b822408328d6b7376c224439831"
server_key_iv: "e64108b98f25aa85de4b96203821dd5c"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.947252 24618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "53acb7480a6c4e13be1f27d3da724a28"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "52cf6b822408328d6b7376c224439831"
server_key_iv: "e64108b98f25aa85de4b96203821dd5c"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.951207 24618 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 05:03:48.953702 24637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.954936 24618 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:03:48.955080 24618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "53acb7480a6c4e13be1f27d3da724a28"
format_stamp: "Formatted at 2026-08-07 05:03:48 on dist-test-slave-lgr5"
server_key: "52cf6b822408328d6b7376c224439831"
server_key_iv: "e64108b98f25aa85de4b96203821dd5c"
server_key_version: "encryptionkey@0"
I20260807 05:03:48.955188 24618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:48.975229 24618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:48.978565 24618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:48.978756 24618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:48.979379 24618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:48.980283 24618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:48.980333 24618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.980387 24618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:48.980412 24618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:48.989375 24618 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:38733
I20260807 05:03:48.989400 24818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:38733 every 8 connection(s)
I20260807 05:03:48.990324 24618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:48.998911 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 24618
I20260807 05:03:48.999091 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:03:48.999430 26459 external_mini_cluster.cc:1428] Setting key 78e541a80e2218a741595ce80e69b21b
Aug 07 05:03:48 dist-test-slave-lgr5 krb5kdc[24040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.195@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:03:49.004458 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.992167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:57615 (local address 127.25.214.254:43151)
0807 05:03:48.992300 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:48.992303 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:48.993178 (+ 875us) server_negotiation.cc:407] Connection header received
0807 05:03:48.994503 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:48.994505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:48.994564 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:48.994639 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:48.995895 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.996505 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.997746 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.997957 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.998027 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.000832 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:49.000835 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:49.000837 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:49.000863 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:49.002308 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:49.002832 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:49.002836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:49.002838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:49.002918 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:49.003271 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:49.003275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:49.003276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:49.003480 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:49.003571 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.004149 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.004287 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:03:49.005348 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:48.992528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43151 (local address 127.25.214.195:57615)
0807 05:03:48.993009 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:48.993063 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:48.994300 (+ 1237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:48.994793 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:48.994799 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:48.995205 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:48.995753 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:48.995770 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.996649 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.996652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:48.997639 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:48.997652 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:48.998080 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:48.998082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:48.998238 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:48.998852 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:03:48.998877 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:49.000661 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:49.002429 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:49.002436 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:49.002456 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:49.002735 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:49.003003 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:03:49.003006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:03:49.003008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:03:49.003177 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:03:49.003594 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:49.003601 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:49.003880 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.004057 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.004470 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":130,"threads_started":1}
I20260807 05:03:49.006500 24819 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43151
I20260807 05:03:49.006747 24819 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:49.007256 24819 heartbeater.cc:511] Master 127.25.214.254:43151 requested a full tablet report, sending...
I20260807 05:03:49.008324 24113 ts_manager.cc:194] Registered new tserver with Master: 53acb7480a6c4e13be1f27d3da724a28 (127.25.214.195:38733)
I20260807 05:03:49.008893 24113 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.214.195@KRBTEST.COM'} at 127.25.214.195:57615
I20260807 05:03:49.013749 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:49.023499 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.015897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.25.214.254:43151)
0807 05:03:49.016009 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.016013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.016332 (+ 319us) server_negotiation.cc:407] Connection header received
0807 05:03:49.016454 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.016457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.016504 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.016577 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:49.017355 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.017892 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.018760 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.018979 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.019072 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.020534 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:49.020538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:49.020540 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:49.020566 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:49.021768 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:49.022186 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:49.022191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:49.022193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:49.022278 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:49.022559 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:49.022563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:49.022565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:49.022802 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:49.022939 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.023185 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.023307 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 05:03:49.026413 24113 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:49.029527 24113 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:49.044278 24835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.038059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:41129 (local address 127.0.0.1:40646)
0807 05:03:49.039093 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.039147 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.039321 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.040013 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.040020 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.040045 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:49.040330 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.040339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.041484 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.041487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.042718 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.042729 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.043689 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.043692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.043798 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.043835 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.043953 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.044118 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":23,"thread_start_us":80,"threads_started":1}
I20260807 05:03:49.044284 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.038199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40646 (local address 127.25.214.194:41129)
0807 05:03:49.038836 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.038849 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.039240 (+ 391us) server_negotiation.cc:407] Connection header received
0807 05:03:49.039479 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.039486 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.039703 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.039815 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:49.040468 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.041333 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.042835 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.043578 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.043690 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.043838 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.043993 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.044129 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":185,"threads_started":1}
I20260807 05:03:49.044545 24836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.038186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:38733 (local address 127.0.0.1:35228)
0807 05:03:49.039116 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.039163 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.039295 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.040039 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.040042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.040056 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:49.040317 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.040325 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.041824 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.041827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.043032 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.043043 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.044155 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.044159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.044249 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.044275 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.044323 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.044391 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":120,"thread_start_us":119,"threads_started":1}
I20260807 05:03:49.044545 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.038897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42263 (local address 127.0.0.1:51980)
0807 05:03:49.039263 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.039275 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.039343 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.040126 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.040128 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.040142 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:49.040336 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.040343 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.041824 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.041827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.043150 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.043160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.044206 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.044209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.044290 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.044308 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.044360 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.044408 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":180,"thread_start_us":91,"threads_started":1}
I20260807 05:03:49.045051 24838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.038682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35228 (local address 127.25.214.195:38733)
0807 05:03:49.039597 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.039608 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.039630 (+ 22us) server_negotiation.cc:407] Connection header received
0807 05:03:49.039707 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.039712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.039903 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.040055 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:49.040439 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.041664 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.043147 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.043981 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.044689 (+ 708us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.044793 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.044833 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.044925 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":158,"threads_started":1}
I20260807 05:03:49.045051 24845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.039316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51980 (local address 127.25.214.193:42263)
0807 05:03:49.039651 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.039665 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.039682 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:03:49.039745 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.039749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.039903 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.040055 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:49.040465 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.041665 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.043276 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.044099 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.044636 (+ 537us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.044769 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.044821 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.044912 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":144,"threads_started":1}
I20260807 05:03:49.047749 24312 tablet_service.cc:1467] Processing CreateTablet for tablet 31b9d30b67284662aa625a0fc8387522 (DEFAULT_TABLE table=test-table [id=9405dd4ebd1445db9c5655167e6ec7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:49.047894 24719 tablet_service.cc:1467] Processing CreateTablet for tablet 31b9d30b67284662aa625a0fc8387522 (DEFAULT_TABLE table=test-table [id=9405dd4ebd1445db9c5655167e6ec7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:49.047894 24509 tablet_service.cc:1467] Processing CreateTablet for tablet 31b9d30b67284662aa625a0fc8387522 (DEFAULT_TABLE table=test-table [id=9405dd4ebd1445db9c5655167e6ec7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:49.048825 24312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b9d30b67284662aa625a0fc8387522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:49.048969 24509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b9d30b67284662aa625a0fc8387522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:49.048969 24719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b9d30b67284662aa625a0fc8387522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:49.055145 24846 tablet_bootstrap.cc:492] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: Bootstrap starting.
I20260807 05:03:49.056591 24850 tablet_bootstrap.cc:492] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Bootstrap starting.
I20260807 05:03:49.056699 24851 tablet_bootstrap.cc:492] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Bootstrap starting.
I20260807 05:03:49.057646 24846 tablet_bootstrap.cc:654] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:49.058387 24851 tablet_bootstrap.cc:654] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:49.058703 24850 tablet_bootstrap.cc:654] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:49.059007 24846 log.cc:824] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:49.059533 24851 log.cc:824] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:49.059891 24850 log.cc:824] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:49.061556 24850 tablet_bootstrap.cc:492] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: No bootstrap required, opened a new log
I20260807 05:03:49.061612 24846 tablet_bootstrap.cc:492] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: No bootstrap required, opened a new log
I20260807 05:03:49.061612 24851 tablet_bootstrap.cc:492] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: No bootstrap required, opened a new log
I20260807 05:03:49.061745 24850 ts_tablet_manager.cc:1397] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 05:03:49.061792 24851 ts_tablet_manager.cc:1397] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:03:49.061792 24846 ts_tablet_manager.cc:1397] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 05:03:49.064685 24850 raft_consensus.cc:348] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.064926 24850 raft_consensus.cc:374] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:49.064999 24850 raft_consensus.cc:729] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53acb7480a6c4e13be1f27d3da724a28, State: Initialized, Role: FOLLOWER
I20260807 05:03:49.065419 24850 consensus_queue.cc:260] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.065553 24846 raft_consensus.cc:348] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.065553 24851 raft_consensus.cc:348] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.065799 24851 raft_consensus.cc:374] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:49.065908 24851 raft_consensus.cc:729] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c29405002892404e92154c12536c5598, State: Initialized, Role: FOLLOWER
I20260807 05:03:49.066088 24819 heartbeater.cc:503] Master 127.25.214.254:43151 was elected leader, sending a full tablet report...
I20260807 05:03:49.066355 24846 raft_consensus.cc:374] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:49.066443 24846 raft_consensus.cc:729] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d517969802b94d8894a945716fe56622, State: Initialized, Role: FOLLOWER
I20260807 05:03:49.066455 24851 consensus_queue.cc:260] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.066838 24846 consensus_queue.cc:260] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.066952 24850 ts_tablet_manager.cc:1428] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 05:03:49.067458 24851 ts_tablet_manager.cc:1428] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:03:49.067667 24846 ts_tablet_manager.cc:1428] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 05:03:49.067922 24410 heartbeater.cc:503] Master 127.25.214.254:43151 was elected leader, sending a full tablet report...
I20260807 05:03:49.067972 24609 heartbeater.cc:503] Master 127.25.214.254:43151 was elected leader, sending a full tablet report...
I20260807 05:03:49.072346 24864 raft_consensus.cc:482] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:49.072490 24864 raft_consensus.cc:504] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.073499 24864 leader_election.cc:288] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c29405002892404e92154c12536c5598 (127.25.214.194:41129), 53acb7480a6c4e13be1f27d3da724a28 (127.25.214.195:38733)
I20260807 05:03:49.078271 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.073964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:43823 (local address 127.25.214.194:41129)
0807 05:03:49.074092 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.074097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.074110 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:03:49.074203 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.074207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.074250 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.074310 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:49.074554 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.075285 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.076924 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.077582 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.077705 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.077756 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.078076 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.078152 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 05:03:49.078271 24838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.073787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:48461 (local address 127.25.214.195:38733)
0807 05:03:49.073911 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.073915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.074110 (+ 195us) server_negotiation.cc:407] Connection header received
0807 05:03:49.074211 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.074214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.074255 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.074313 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:49.074747 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.075455 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.076927 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.077582 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.077705 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.077756 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.078076 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.078152 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 05:03:49.078330 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.073711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:38733 (local address 127.25.214.193:48461)
0807 05:03:49.074014 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.074027 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.074134 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.074502 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.074505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.074523 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:49.074635 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.074642 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.075566 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.075569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.076778 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.076784 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.077701 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.077705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.077871 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.077948 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.078025 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.078135 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":97,"thread_start_us":132,"threads_started":1}
I20260807 05:03:49.078336 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.073660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:41129 (local address 127.25.214.193:43823)
0807 05:03:49.074001 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.074017 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.074122 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.074326 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.074328 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.074345 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:49.074461 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.074467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.075415 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.075418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.076768 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.076781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.077701 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.077705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.077880 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.077944 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.078025 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.078135 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":84,"thread_start_us":87,"threads_started":1}
I20260807 05:03:49.078969 24749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b9d30b67284662aa625a0fc8387522" candidate_uuid: "d517969802b94d8894a945716fe56622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53acb7480a6c4e13be1f27d3da724a28" is_pre_election: true
I20260807 05:03:49.079116 24541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b9d30b67284662aa625a0fc8387522" candidate_uuid: "d517969802b94d8894a945716fe56622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c29405002892404e92154c12536c5598" is_pre_election: true
I20260807 05:03:49.079262 24749 raft_consensus.cc:2454] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d517969802b94d8894a945716fe56622 in term 0.
I20260807 05:03:49.079331 24541 raft_consensus.cc:2454] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d517969802b94d8894a945716fe56622 in term 0.
I20260807 05:03:49.079762 24234 leader_election.cc:302] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 53acb7480a6c4e13be1f27d3da724a28, c29405002892404e92154c12536c5598, d517969802b94d8894a945716fe56622; no voters:
I20260807 05:03:49.080017 24864 raft_consensus.cc:2781] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:49.080120 24864 raft_consensus.cc:482] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:49.080178 24864 raft_consensus.cc:3037] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:49.081192 24864 raft_consensus.cc:504] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.081516 24864 leader_election.cc:288] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [CANDIDATE]: Term 1 election: Requested vote from peers c29405002892404e92154c12536c5598 (127.25.214.194:41129), 53acb7480a6c4e13be1f27d3da724a28 (127.25.214.195:38733)
I20260807 05:03:49.081826 24541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b9d30b67284662aa625a0fc8387522" candidate_uuid: "d517969802b94d8894a945716fe56622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c29405002892404e92154c12536c5598"
I20260807 05:03:49.081861 24749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b9d30b67284662aa625a0fc8387522" candidate_uuid: "d517969802b94d8894a945716fe56622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53acb7480a6c4e13be1f27d3da724a28"
I20260807 05:03:49.081955 24749 raft_consensus.cc:3037] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:49.081955 24541 raft_consensus.cc:3037] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:49.083197 24541 raft_consensus.cc:2454] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d517969802b94d8894a945716fe56622 in term 1.
I20260807 05:03:49.083197 24749 raft_consensus.cc:2454] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d517969802b94d8894a945716fe56622 in term 1.
I20260807 05:03:49.083534 24233 leader_election.cc:302] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c29405002892404e92154c12536c5598, d517969802b94d8894a945716fe56622; no voters:
I20260807 05:03:49.083784 24864 raft_consensus.cc:2781] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:49.083997 24864 raft_consensus.cc:686] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [term 1 LEADER]: Becoming Leader. State: Replica: d517969802b94d8894a945716fe56622, State: Running, Role: LEADER
I20260807 05:03:49.084309 24864 consensus_queue.cc:237] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } }
I20260807 05:03:49.087272 24110 catalog_manager.cc:5495] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 reported cstate change: term changed from 0 to 1, leader changed from <none> to d517969802b94d8894a945716fe56622 (127.25.214.193). New cstate: current_term: 1 leader_uuid: "d517969802b94d8894a945716fe56622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d517969802b94d8894a945716fe56622" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 42263 } health_report { overall_health: HEALTHY } } }
I20260807 05:03:49.107147 24845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.103582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51986 (local address 127.25.214.193:42263)
0807 05:03:49.103711 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.103714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.103728 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:03:49.103813 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.103815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.103887 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.103978 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:49.104258 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.104757 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.105642 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.105872 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.105969 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.106252 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:49.106767 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:49.106873 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.106933 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.106992 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:03:49.113620 24541 raft_consensus.cc:1261] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 1 FOLLOWER]: Refusing update from remote peer d517969802b94d8894a945716fe56622: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:49.113620 24749 raft_consensus.cc:1261] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 1 FOLLOWER]: Refusing update from remote peer d517969802b94d8894a945716fe56622: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:49.114494 24864 consensus_queue.cc:1035] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53acb7480a6c4e13be1f27d3da724a28" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 38733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:49.114744 24867 consensus_queue.cc:1035] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c29405002892404e92154c12536c5598" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:49.124069 24871 mvcc.cc:205] Tried to move back new op lower bound from 7315779703240994816 to 7315779703131815936. Current Snapshot: MvccSnapshot[applied={T|T < 7315779703240994816}]
I20260807 05:03:49.131853 24112 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:49.132038 24112 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:49.134505 24112 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24d00f254a7c439d96018d31fe2f9113: Sending DeleteTablet for 3 replicas of tablet 31b9d30b67284662aa625a0fc8387522
I20260807 05:03:49.135426 24312 tablet_service.cc:1514] Processing DeleteTablet for tablet 31b9d30b67284662aa625a0fc8387522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:49 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:51980
I20260807 05:03:49.135528 24719 tablet_service.cc:1514] Processing DeleteTablet for tablet 31b9d30b67284662aa625a0fc8387522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:49 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:35228
I20260807 05:03:49.135918 24886 tablet_replica.cc:330] T 31b9d30b67284662aa625a0fc8387522 P d517969802b94d8894a945716fe56622: stopping tablet replica
I20260807 05:03:49.136127 24509 tablet_service.cc:1514] Processing DeleteTablet for tablet 31b9d30b67284662aa625a0fc8387522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:49 UTC) from {username='kudu', principal='kudu/127.25.214.254@KRBTEST.COM'} at 127.0.0.1:40646
I20260807 05:03:49.136336 24887 tablet_replica.cc:330] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: stopping tablet replica
I20260807 05:03:49.136472 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 24211
I20260807 05:03:49.136636 24887 raft_consensus.cc:2229] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:49.139530 24889 tablet_replica.cc:330] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: stopping tablet replica
I20260807 05:03:49.139830 24889 raft_consensus.cc:2229] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:49.140192 24889 raft_consensus.cc:2258] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:49.144729 24887 raft_consensus.cc:2258] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:49.146869 24887 ts_tablet_manager.cc:1905] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:49.146914 24889 ts_tablet_manager.cc:1905] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:49.149158 24887 ts_tablet_manager.cc:1918] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:49.149260 24887 log.cc:1196] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/31b9d30b67284662aa625a0fc8387522
I20260807 05:03:49.149565 24887 ts_tablet_manager.cc:1939] T 31b9d30b67284662aa625a0fc8387522 P 53acb7480a6c4e13be1f27d3da724a28: Deleting consensus metadata
I20260807 05:03:49.149605 24889 ts_tablet_manager.cc:1918] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:49.149734 24889 log.cc:1196] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/31b9d30b67284662aa625a0fc8387522
I20260807 05:03:49.150054 24889 ts_tablet_manager.cc:1939] T 31b9d30b67284662aa625a0fc8387522 P c29405002892404e92154c12536c5598: Deleting consensus metadata
I20260807 05:03:49.150856 24084 catalog_manager.cc:4841] TS 53acb7480a6c4e13be1f27d3da724a28 (127.25.214.195:38733): tablet 31b9d30b67284662aa625a0fc8387522 (table test-table [id=9405dd4ebd1445db9c5655167e6ec7e7]) successfully deleted
I20260807 05:03:49.151129 24083 catalog_manager.cc:4841] TS c29405002892404e92154c12536c5598 (127.25.214.194:41129): tablet 31b9d30b67284662aa625a0fc8387522 (table test-table [id=9405dd4ebd1445db9c5655167e6ec7e7]) successfully deleted
W20260807 05:03:49.152976 24087 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:42263 (error 108)
I20260807 05:03:49.153204 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 24415
I20260807 05:03:49.167910 24835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.167551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:42263 (local address 127.0.0.1:52000)
0807 05:03:49.167706 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.167802 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 05:03:49.168289 24087 catalog_manager.cc:4584] TS d517969802b94d8894a945716fe56622 (127.25.214.193:42263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31b9d30b67284662aa625a0fc8387522: Network error: Client connection negotiation failed: client connection to 127.25.214.193:42263: connect: Connection refused (error 111)
I20260807 05:03:49.172938 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 24618
I20260807 05:03:49.182783 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 24061
2026-08-07T05:03:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2418 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T05:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:49Z Disabled control of system clock
I20260807 05:03:49.221104 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43387
--webserver_interface=127.25.214.254
--webserver_port=0
--builtin_ntp_servers=127.25.214.212:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:43387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 05:03:49.334527 24894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:49.334805 24894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:49.334839 24894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:49.338790 24894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:49.338850 24894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:49.338863 24894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:49.338878 24894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:49.338892 24894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:49.343569 24894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:43387
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:43387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:49.344647 24894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:49.346015 24894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:49.354950 24901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:49.354957 24904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:49.355110 24894 server_base.cc:1034] running on GCE node
W20260807 05:03:49.355366 24902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:49.355986 24894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:49.357259 24894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:49.358434 24894 hybrid_clock.cc:648] HybridClock initialized: now 1786079029358410 us; error 43 us; skew 500 ppm
I20260807 05:03:49.360486 24894 webserver.cc:460] Webserver started at http://127.25.214.254:45521/ using document root <none> and password file <none>
I20260807 05:03:49.361080 24894 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:49.361151 24894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:49.361366 24894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:49.363508 24894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "09448a927e564431b4f9f5fc929fd34f"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "93ece241561d60a22943766e128f8680"
server_key_iv: "5d264907762ef0db5285f8ac372aa488"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.364068 24894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "09448a927e564431b4f9f5fc929fd34f"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "93ece241561d60a22943766e128f8680"
server_key_iv: "5d264907762ef0db5285f8ac372aa488"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.367942 24894 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 05:03:49.370801 24912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.372215 24894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:49.372360 24894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "09448a927e564431b4f9f5fc929fd34f"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "93ece241561d60a22943766e128f8680"
server_key_iv: "5d264907762ef0db5285f8ac372aa488"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.372494 24894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:49.397044 24894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:49.397853 24894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:49.398049 24894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:49.405441 24894 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:43387
I20260807 05:03:49.405448 24987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:43387 every 8 connection(s)
I20260807 05:03:49.406520 24894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:49.407316 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 24894
I20260807 05:03:49.407471 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:49.407815 26459 external_mini_cluster.cc:1428] Setting key b9c6c86b7c374a8803695c4438a5acaa
I20260807 05:03:49.410527 24988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:49.416731 24988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f: Bootstrap starting.
I20260807 05:03:49.417713 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.409455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.25.214.254:43387)
0807 05:03:49.410157 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.410171 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.410208 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:03:49.410922 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.410946 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.411355 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.411672 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:49.412160 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.413138 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.414177 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.414684 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.414840 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.415843 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:49.415849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:49.415862 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:49.416305 (+ 443us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:49.416366 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:49.416398 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:49.416489 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.416634 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.416939 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":156,"threads_started":1}
I20260807 05:03:49.419157 24988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:49.419978 24988 log.cc:824] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:49.422024 24988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f: No bootstrap required, opened a new log
I20260807 05:03:49.425874 24988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09448a927e564431b4f9f5fc929fd34f" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43387 } }
I20260807 05:03:49.426124 24988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:49.426160 24988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09448a927e564431b4f9f5fc929fd34f, State: Initialized, Role: FOLLOWER
I20260807 05:03:49.426548 24988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09448a927e564431b4f9f5fc929fd34f" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43387 } }
I20260807 05:03:49.426661 24988 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:49.426707 24988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:49.426780 24988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:49.427799 24988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09448a927e564431b4f9f5fc929fd34f" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43387 } }
I20260807 05:03:49.428182 24988 leader_election.cc:302] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09448a927e564431b4f9f5fc929fd34f; no voters:
I20260807 05:03:49.428526 24988 leader_election.cc:288] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:49.428633 24996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:49.428890 24996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [term 1 LEADER]: Becoming Leader. State: Replica: 09448a927e564431b4f9f5fc929fd34f, State: Running, Role: LEADER
I20260807 05:03:49.429224 24996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09448a927e564431b4f9f5fc929fd34f" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43387 } }
I20260807 05:03:49.429930 24988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:49.430960 24999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09448a927e564431b4f9f5fc929fd34f. Latest consensus state: current_term: 1 leader_uuid: "09448a927e564431b4f9f5fc929fd34f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09448a927e564431b4f9f5fc929fd34f" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43387 } } }
I20260807 05:03:49.430984 24997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09448a927e564431b4f9f5fc929fd34f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09448a927e564431b4f9f5fc929fd34f" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 43387 } } }
I20260807 05:03:49.431123 24999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:49.431123 24997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:49.431609 25010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:49.434803 25010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:49.441045 25010 catalog_manager.cc:1347] Generated new cluster ID: 72e16331e7f24a1e9d81b7eafee8ab5b
I20260807 05:03:49.441147 25010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:49.450417 25010 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:49.451676 25010 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:49.461850 25010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f: Generated new TSK 0
I20260807 05:03:49.462581 25010 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:49.470455 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.193:0
--local_ip_for_outbound_sockets=127.25.214.193
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43387
--builtin_ntp_servers=127.25.214.212:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 05:03:49.588236 25024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:49.588511 25024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:49.588551 25024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:49.592672 25024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:49.592749 25024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:49.592809 25024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.193
I20260807 05:03:49.597906 25024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.214.193
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.193
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:49.599107 25024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:49.600593 25024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:49.610375 25036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:49.610394 25040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:49.610396 25035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:49.610460 25024 server_base.cc:1034] running on GCE node
I20260807 05:03:49.611048 25024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:49.611721 25024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:49.612893 25024 hybrid_clock.cc:648] HybridClock initialized: now 1786079029612866 us; error 36 us; skew 500 ppm
I20260807 05:03:49.614768 25024 webserver.cc:460] Webserver started at http://127.25.214.193:42833/ using document root <none> and password file <none>
I20260807 05:03:49.615358 25024 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:49.615437 25024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:49.615646 25024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:49.617784 25024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data/instance:
uuid: "d34ab50d8eed4b5f9e4e41566d602772"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "69470def4c645cac3ba629009562a87a"
server_key_iv: "8e01cd70d5a94b8e44fd8878bd6aed9c"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.618321 25024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance:
uuid: "d34ab50d8eed4b5f9e4e41566d602772"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "69470def4c645cac3ba629009562a87a"
server_key_iv: "8e01cd70d5a94b8e44fd8878bd6aed9c"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.621964 25024 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 05:03:49.624373 25056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.625562 25024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:49.625671 25024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal
uuid: "d34ab50d8eed4b5f9e4e41566d602772"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "69470def4c645cac3ba629009562a87a"
server_key_iv: "8e01cd70d5a94b8e44fd8878bd6aed9c"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.625764 25024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:49.668919 25024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:49.669667 25024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:49.669853 25024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:49.670473 25024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:49.671518 25024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:49.671577 25024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.671624 25024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:49.671649 25024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.680292 25024 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.193:33765
I20260807 05:03:49.680322 25242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.193:33765 every 8 connection(s)
I20260807 05:03:49.681242 25024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/data/info.pb
I20260807 05:03:49.688362 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 25024
I20260807 05:03:49.688481 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-0/wal/instance
I20260807 05:03:49.688769 26459 external_mini_cluster.cc:1428] Setting key 436d27c5664e7686118c032abf488250
I20260807 05:03:49.690398 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.683064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.193:53521 (local address 127.25.214.254:43387)
0807 05:03:49.683197 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.683200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.684277 (+ 1077us) server_negotiation.cc:407] Connection header received
0807 05:03:49.685667 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.685671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.685729 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.685801 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:49.686698 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.687249 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.688429 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.688699 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.688787 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.689861 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:49.689865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:49.689868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:49.689881 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:49.689908 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:49.689917 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:49.689984 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.690170 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.690246 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:03:49.690811 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.194:0
--local_ip_for_outbound_sockets=127.25.214.194
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43387
--builtin_ntp_servers=127.25.214.212:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 05:03:49.691419 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.683462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43387 (local address 127.25.214.193:53521)
0807 05:03:49.684128 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.684182 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.685465 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.685988 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.685995 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.686080 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:49.686565 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.686577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.687365 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.687368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.688317 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.688327 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.688863 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.688868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.689031 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.689606 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:49.689608 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:49.689651 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:49.689720 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:49.689996 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:49.690007 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:49.690016 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.690157 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.690430 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":111,"threads_started":1}
I20260807 05:03:49.692627 25243 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43387
I20260807 05:03:49.692848 25243 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:49.693357 25243 heartbeater.cc:511] Master 127.25.214.254:43387 requested a full tablet report, sending...
I20260807 05:03:49.694815 24932 ts_manager.cc:194] Registered new tserver with Master: d34ab50d8eed4b5f9e4e41566d602772 (127.25.214.193:33765)
I20260807 05:03:49.695951 24932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.193:53521
W20260807 05:03:49.800738 25246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:49.801025 25246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:49.801065 25246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:49.805081 25246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:49.805145 25246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:49.805198 25246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.194
I20260807 05:03:49.810185 25246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.214.194
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.194
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:49.811235 25246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:49.812638 25246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:49.822218 25257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:49.822217 25254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:49.822275 25252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:49.822278 25246 server_base.cc:1034] running on GCE node
I20260807 05:03:49.822902 25246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:49.823508 25246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:49.824658 25246 hybrid_clock.cc:648] HybridClock initialized: now 1786079029824629 us; error 49 us; skew 500 ppm
I20260807 05:03:49.826421 25246 webserver.cc:460] Webserver started at http://127.25.214.194:32789/ using document root <none> and password file <none>
I20260807 05:03:49.827004 25246 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:49.827075 25246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:49.827287 25246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:49.829499 25246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data/instance:
uuid: "1b4a8f47cc4e4172a9bc606515e53b67"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "40d90ed0199cff7c160fc3d054c44371"
server_key_iv: "f0dc0ec9a2eb49d1169ad250a768414a"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.830145 25246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance:
uuid: "1b4a8f47cc4e4172a9bc606515e53b67"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "40d90ed0199cff7c160fc3d054c44371"
server_key_iv: "f0dc0ec9a2eb49d1169ad250a768414a"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.834271 25246 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:03:49.836905 25263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.838315 25246 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:03:49.838466 25246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal
uuid: "1b4a8f47cc4e4172a9bc606515e53b67"
format_stamp: "Formatted at 2026-08-07 05:03:49 on dist-test-slave-lgr5"
server_key: "40d90ed0199cff7c160fc3d054c44371"
server_key_iv: "f0dc0ec9a2eb49d1169ad250a768414a"
server_key_version: "encryptionkey@0"
I20260807 05:03:49.838596 25246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:49.864177 25246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:49.864919 25246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:49.865103 25246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:49.865727 25246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:49.866721 25246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:49.866770 25246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.866827 25246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:49.866855 25246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:49.875703 25246 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.194:36895
I20260807 05:03:49.875708 25435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.194:36895 every 8 connection(s)
I20260807 05:03:49.876754 25246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/data/info.pb
I20260807 05:03:49.878070 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 25246
I20260807 05:03:49.878208 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal/instance
I20260807 05:03:49.878512 26459 external_mini_cluster.cc:1428] Setting key 6af324fa33b6d5563c25e9fa7eee695b
I20260807 05:03:49.880491 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.214.195:0
--local_ip_for_outbound_sockets=127.25.214.195
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43387
--builtin_ntp_servers=127.25.214.212:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 05:03:49.886276 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.878765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.194:60681 (local address 127.25.214.254:43387)
0807 05:03:49.878938 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:49.878943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:49.880219 (+ 1276us) server_negotiation.cc:407] Connection header received
0807 05:03:49.881639 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:49.881642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:49.881698 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:49.881777 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:49.882671 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.883189 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.884365 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.884593 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.884682 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.885782 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:49.885786 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:49.885789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:49.885804 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:49.885825 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:49.885833 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:49.885892 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:49.886043 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 05:03:49.886118 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:03:49.887197 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:49.879287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43387 (local address 127.25.214.194:60681)
0807 05:03:49.880031 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:49.880118 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:49.881427 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:49.881943 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:49.881949 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:49.882035 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:49.882526 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.882537 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.883307 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.883310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.884244 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:49.884255 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:49.884738 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:49.884743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:49.884906 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:49.885520 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:49.885522 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:49.885564 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:49.885633 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:49.885902 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:49.885920 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:49.885925 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 05:03:49.886035 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 05:03:49.886339 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":122,"threads_started":1}
I20260807 05:03:49.888447 25438 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43387
I20260807 05:03:49.888774 25438 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:49.889521 25438 heartbeater.cc:511] Master 127.25.214.254:43387 requested a full tablet report, sending...
I20260807 05:03:49.890869 24932 ts_manager.cc:194] Registered new tserver with Master: 1b4a8f47cc4e4172a9bc606515e53b67 (127.25.214.194:36895)
I20260807 05:03:49.891726 24932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.194:60681
W20260807 05:03:49.998076 25441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:49.998338 25441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:49.998379 25441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:50.002491 25441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:50.002555 25441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:50.002611 25441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.214.195
I20260807 05:03:50.007333 25441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.214.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.214.195
--webserver_port=0
--tserver_master_addrs=127.25.214.254:43387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.214.195
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:50.008422 25441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:50.009797 25441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:50.019645 25446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:50.019652 25447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:50.019687 25450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:50.020025 25441 server_base.cc:1034] running on GCE node
I20260807 05:03:50.020488 25441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:50.021166 25441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:50.022331 25441 hybrid_clock.cc:648] HybridClock initialized: now 1786079030022311 us; error 34 us; skew 500 ppm
I20260807 05:03:50.024394 25441 webserver.cc:460] Webserver started at http://127.25.214.195:37557/ using document root <none> and password file <none>
I20260807 05:03:50.025012 25441 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:50.025082 25441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:50.025367 25441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:50.027671 25441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data/instance:
uuid: "a76f0cba2ba54e27a05bacb93f869314"
format_stamp: "Formatted at 2026-08-07 05:03:50 on dist-test-slave-lgr5"
server_key: "cc227ea87a3e1784c39cfd942ca2511b"
server_key_iv: "47ccf5cbc60498c9c30839dcac2ce7bc"
server_key_version: "encryptionkey@0"
I20260807 05:03:50.028273 25441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance:
uuid: "a76f0cba2ba54e27a05bacb93f869314"
format_stamp: "Formatted at 2026-08-07 05:03:50 on dist-test-slave-lgr5"
server_key: "cc227ea87a3e1784c39cfd942ca2511b"
server_key_iv: "47ccf5cbc60498c9c30839dcac2ce7bc"
server_key_version: "encryptionkey@0"
I20260807 05:03:50.032336 25441 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:03:50.034842 25463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:50.036115 25441 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:50.036237 25441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal
uuid: "a76f0cba2ba54e27a05bacb93f869314"
format_stamp: "Formatted at 2026-08-07 05:03:50 on dist-test-slave-lgr5"
server_key: "cc227ea87a3e1784c39cfd942ca2511b"
server_key_iv: "47ccf5cbc60498c9c30839dcac2ce7bc"
server_key_version: "encryptionkey@0"
I20260807 05:03:50.036339 25441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:50.064299 25441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:50.065070 25441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:50.065255 25441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:50.065872 25441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 05:03:50.066871 25441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 05:03:50.066921 25441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:50.066987 25441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 05:03:50.067013 25441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:50.076181 25441 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.195:33595
I20260807 05:03:50.076254 25658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.195:33595 every 8 connection(s)
I20260807 05:03:50.077157 25441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/data/info.pb
I20260807 05:03:50.077986 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 25441
I20260807 05:03:50.078100 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal/instance
I20260807 05:03:50.078383 26459 external_mini_cluster.cc:1428] Setting key e608548250143daee9b6d7be06887b31
I20260807 05:03:50.086771 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.079098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:43201 (local address 127.25.214.254:43387)
0807 05:03:50.079265 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.079270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.080565 (+ 1295us) server_negotiation.cc:407] Connection header received
0807 05:03:50.081983 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.081987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.082043 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.082112 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:50.083038 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.083566 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.084791 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.085027 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.085118 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.086257 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:50.086261 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:50.086263 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:50.086280 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:50.086300 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:50.086308 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:50.086366 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.086546 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.086616 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 05:03:50.087647 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.079664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:43387 (local address 127.25.214.195:43201)
0807 05:03:50.080413 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.080472 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:50.081774 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:50.082286 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:50.082294 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:50.082388 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:03:50.082893 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.082906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.083693 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.083695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.084666 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.084677 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.085179 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.085184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.085348 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.085977 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 05:03:50.085979 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:03:50.086023 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 05:03:50.086098 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:03:50.086405 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:03:50.086413 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:03:50.086418 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 05:03:50.086530 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 05:03:50.086833 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":153,"threads_started":1}
I20260807 05:03:50.088805 25660 heartbeater.cc:347] Connected to a master server at 127.25.214.254:43387
I20260807 05:03:50.089057 25660 heartbeater.cc:464] Registering TS with master...
I20260807 05:03:50.089623 25660 heartbeater.cc:511] Master 127.25.214.254:43387 requested a full tablet report, sending...
I20260807 05:03:50.090674 24932 ts_manager.cc:194] Registered new tserver with Master: a76f0cba2ba54e27a05bacb93f869314 (127.25.214.195:33595)
I20260807 05:03:50.091331 24932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.214.195:43201
I20260807 05:03:50.092542 26459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 05:03:50.098021 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.094444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.25.214.254:43387)
0807 05:03:50.094599 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.094604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.094741 (+ 137us) server_negotiation.cc:407] Connection header received
0807 05:03:50.094849 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.094852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.094891 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.094953 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:50.095166 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.095659 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.096568 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.096787 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.096883 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.097664 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:50.097667 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:50.097669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:50.097682 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:50.097700 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:50.097707 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:50.097771 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.097829 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.097874 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 05:03:50.100726 24932 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 05:03:50.103773 24932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 05:03:50.118216 25675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.112598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.195:33595 (local address 127.0.0.1:41280)
0807 05:03:50.113342 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.113355 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:50.113430 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:50.114353 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:50.114355 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:50.114371 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:50.114458 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.114464 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.115492 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.115495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.116813 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.116824 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.117684 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.117687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.117795 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.117831 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 05:03:50.117946 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 05:03:50.118063 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":43,"thread_start_us":82,"threads_started":1}
I20260807 05:03:50.118229 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.113156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41280 (local address 127.25.214.195:33595)
0807 05:03:50.113927 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.113939 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.113963 (+ 24us) server_negotiation.cc:407] Connection header received
0807 05:03:50.114041 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.114045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.114219 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.114378 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:50.114547 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.115381 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.116941 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.117572 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.117685 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.117870 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.117975 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.118067 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":150,"threads_started":1}
I20260807 05:03:50.118391 25676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.112476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36895 (local address 127.0.0.1:48032)
0807 05:03:50.112965 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.113016 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:50.113142 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:50.114174 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:50.114179 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:50.114199 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:50.114334 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.114342 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.115871 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.115875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.116979 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.116987 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.117990 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.117994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.118097 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.118122 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 05:03:50.118171 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 05:03:50.118238 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260807 05:03:50.118639 25680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.113261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:33765 (local address 127.0.0.1:51962)
0807 05:03:50.113599 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.113610 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:50.113684 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:50.114534 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:50.114537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:50.114555 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:50.114654 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.114660 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.115979 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.115982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.117083 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.117093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.118272 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.118275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.118368 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.118391 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 05:03:50.118460 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 05:03:50.118528 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260807 05:03:50.118760 25688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.113705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.25.214.193:33765)
0807 05:03:50.114033 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.114044 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.114062 (+ 18us) server_negotiation.cc:407] Connection header received
0807 05:03:50.114123 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.114128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.114266 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.114396 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:50.114771 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.115878 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.117212 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.117954 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.118054 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.118214 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.118512 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.118607 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":121,"threads_started":1}
I20260807 05:03:50.118984 25677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.112594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48032 (local address 127.25.214.194:36895)
0807 05:03:50.113662 (+ 1068us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.113675 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.113701 (+ 26us) server_negotiation.cc:407] Connection header received
0807 05:03:50.113779 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.113785 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.113998 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.114496 (+ 498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:50.114625 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.115748 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.117081 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.117847 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.118543 (+ 696us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.118701 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.118753 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.118841 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":952,"thread_start_us":135,"threads_started":1}
I20260807 05:03:50.121650 25550 tablet_service.cc:1467] Processing CreateTablet for tablet e973edd382664948bfe1fcf295ac8371 (DEFAULT_TABLE table=test-table [id=78759482d11843209ede137b13a22b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:50.121743 25127 tablet_service.cc:1467] Processing CreateTablet for tablet e973edd382664948bfe1fcf295ac8371 (DEFAULT_TABLE table=test-table [id=78759482d11843209ede137b13a22b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:50.121743 25340 tablet_service.cc:1467] Processing CreateTablet for tablet e973edd382664948bfe1fcf295ac8371 (DEFAULT_TABLE table=test-table [id=78759482d11843209ede137b13a22b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 05:03:50.122613 25550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e973edd382664948bfe1fcf295ac8371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:50.122730 25340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e973edd382664948bfe1fcf295ac8371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:50.122730 25127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e973edd382664948bfe1fcf295ac8371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:50.129554 25690 tablet_bootstrap.cc:492] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Bootstrap starting.
I20260807 05:03:50.130905 25692 tablet_bootstrap.cc:492] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Bootstrap starting.
I20260807 05:03:50.132226 25690 tablet_bootstrap.cc:654] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:50.132457 25691 tablet_bootstrap.cc:492] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: Bootstrap starting.
I20260807 05:03:50.132727 25692 tablet_bootstrap.cc:654] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:50.133042 25690 log.cc:824] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:50.133526 25692 log.cc:824] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:50.134466 25691 tablet_bootstrap.cc:654] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:50.135185 25690 tablet_bootstrap.cc:492] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: No bootstrap required, opened a new log
I20260807 05:03:50.135324 25691 log.cc:824] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:50.135380 25690 ts_tablet_manager.cc:1397] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260807 05:03:50.135671 25692 tablet_bootstrap.cc:492] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: No bootstrap required, opened a new log
I20260807 05:03:50.135895 25692 ts_tablet_manager.cc:1397] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 05:03:50.137351 25691 tablet_bootstrap.cc:492] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: No bootstrap required, opened a new log
I20260807 05:03:50.137526 25691 ts_tablet_manager.cc:1397] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 05:03:50.138994 25690 raft_consensus.cc:348] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.139292 25690 raft_consensus.cc:374] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:50.139377 25690 raft_consensus.cc:729] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76f0cba2ba54e27a05bacb93f869314, State: Initialized, Role: FOLLOWER
I20260807 05:03:50.139885 25690 consensus_queue.cc:260] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.140116 25692 raft_consensus.cc:348] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.140389 25692 raft_consensus.cc:374] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:50.140456 25692 raft_consensus.cc:729] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b4a8f47cc4e4172a9bc606515e53b67, State: Initialized, Role: FOLLOWER
I20260807 05:03:50.141016 25690 ts_tablet_manager.cc:1428] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 05:03:50.141029 25692 consensus_queue.cc:260] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.141485 25660 heartbeater.cc:503] Master 127.25.214.254:43387 was elected leader, sending a full tablet report...
I20260807 05:03:50.141968 25691 raft_consensus.cc:348] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.142231 25691 raft_consensus.cc:374] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:50.142300 25691 raft_consensus.cc:729] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d34ab50d8eed4b5f9e4e41566d602772, State: Initialized, Role: FOLLOWER
I20260807 05:03:50.142731 25691 consensus_queue.cc:260] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.143214 25438 heartbeater.cc:503] Master 127.25.214.254:43387 was elected leader, sending a full tablet report...
I20260807 05:03:50.143743 25691 ts_tablet_manager.cc:1428] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 05:03:50.144194 25243 heartbeater.cc:503] Master 127.25.214.254:43387 was elected leader, sending a full tablet report...
I20260807 05:03:50.145346 25692 ts_tablet_manager.cc:1428] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Time spent starting tablet: real 0.009s user 0.002s sys 0.003s
W20260807 05:03:50.182412 25244 tablet.cc:2369] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:03:50.293561 25700 raft_consensus.cc:482] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 05:03:50.293780 25700 raft_consensus.cc:504] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.294932 25700 leader_election.cc:288] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b4a8f47cc4e4172a9bc606515e53b67 (127.25.214.194:36895), d34ab50d8eed4b5f9e4e41566d602772 (127.25.214.193:33765)
I20260807 05:03:50.298760 25688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.295336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:36043 (local address 127.25.214.193:33765)
0807 05:03:50.295462 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.295467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.295716 (+ 249us) server_negotiation.cc:407] Connection header received
0807 05:03:50.295817 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.295820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.295875 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.295940 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:50.296229 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.296721 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.297807 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.298186 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.298286 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.298351 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.298570 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.298636 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 05:03:50.298760 25677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.295297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.214.195:40373 (local address 127.25.214.194:36895)
0807 05:03:50.295434 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.295438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.295513 (+ 75us) server_negotiation.cc:407] Connection header received
0807 05:03:50.295666 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.295670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.295727 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.295796 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 05:03:50.296303 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.296793 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.297792 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.298177 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.298284 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.298338 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.298573 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.298645 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 05:03:50.298760 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.295203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.194:36895 (local address 127.25.214.195:40373)
0807 05:03:50.295422 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.295437 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:50.295554 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:50.296033 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:50.296035 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:50.296051 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:50.296190 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.296197 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.296913 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.296917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.297676 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.297685 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.298306 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.298310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.298457 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.298477 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 05:03:50.298543 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 05:03:50.298614 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":30}
I20260807 05:03:50.298772 25704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.295247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:33765 (local address 127.25.214.195:36043)
0807 05:03:50.295631 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.295642 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:03:50.295739 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:03:50.295960 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:03:50.295962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:03:50.295974 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 05:03:50.296111 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.296117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.296836 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.296840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.297682 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:03:50.297691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.298288 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.298292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:03:50.298434 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.298472 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 05:03:50.298538 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 05:03:50.298608 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":66,"thread_start_us":146,"threads_started":1}
I20260807 05:03:50.299399 25366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e973edd382664948bfe1fcf295ac8371" candidate_uuid: "a76f0cba2ba54e27a05bacb93f869314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" is_pre_election: true
I20260807 05:03:50.299408 25166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e973edd382664948bfe1fcf295ac8371" candidate_uuid: "a76f0cba2ba54e27a05bacb93f869314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d34ab50d8eed4b5f9e4e41566d602772" is_pre_election: true
I20260807 05:03:50.299687 25366 raft_consensus.cc:2454] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a76f0cba2ba54e27a05bacb93f869314 in term 0.
I20260807 05:03:50.299708 25166 raft_consensus.cc:2454] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a76f0cba2ba54e27a05bacb93f869314 in term 0.
I20260807 05:03:50.300195 25464 leader_election.cc:302] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b4a8f47cc4e4172a9bc606515e53b67, a76f0cba2ba54e27a05bacb93f869314; no voters:
I20260807 05:03:50.300474 25700 raft_consensus.cc:2781] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 05:03:50.300566 25700 raft_consensus.cc:482] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 05:03:50.300611 25700 raft_consensus.cc:3037] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:50.301626 25700 raft_consensus.cc:504] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.301921 25700 leader_election.cc:288] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [CANDIDATE]: Term 1 election: Requested vote from peers 1b4a8f47cc4e4172a9bc606515e53b67 (127.25.214.194:36895), d34ab50d8eed4b5f9e4e41566d602772 (127.25.214.193:33765)
I20260807 05:03:50.302222 25366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e973edd382664948bfe1fcf295ac8371" candidate_uuid: "a76f0cba2ba54e27a05bacb93f869314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b4a8f47cc4e4172a9bc606515e53b67"
I20260807 05:03:50.302270 25166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e973edd382664948bfe1fcf295ac8371" candidate_uuid: "a76f0cba2ba54e27a05bacb93f869314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d34ab50d8eed4b5f9e4e41566d602772"
I20260807 05:03:50.302353 25366 raft_consensus.cc:3037] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:50.302364 25166 raft_consensus.cc:3037] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:50.303326 25366 raft_consensus.cc:2454] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a76f0cba2ba54e27a05bacb93f869314 in term 1.
I20260807 05:03:50.303377 25166 raft_consensus.cc:2454] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a76f0cba2ba54e27a05bacb93f869314 in term 1.
I20260807 05:03:50.303653 25471 leader_election.cc:302] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a76f0cba2ba54e27a05bacb93f869314, d34ab50d8eed4b5f9e4e41566d602772; no voters:
I20260807 05:03:50.303814 25700 raft_consensus.cc:2781] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:50.304062 25700 raft_consensus.cc:686] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 1 LEADER]: Becoming Leader. State: Replica: a76f0cba2ba54e27a05bacb93f869314, State: Running, Role: LEADER
I20260807 05:03:50.304416 25700 consensus_queue.cc:237] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } }
I20260807 05:03:50.307317 24931 catalog_manager.cc:5495] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 reported cstate change: term changed from 0 to 1, leader changed from <none> to a76f0cba2ba54e27a05bacb93f869314 (127.25.214.195). New cstate: current_term: 1 leader_uuid: "a76f0cba2ba54e27a05bacb93f869314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a76f0cba2ba54e27a05bacb93f869314" member_type: VOTER last_known_addr { host: "127.25.214.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 } health_report { overall_health: UNKNOWN } } }
W20260807 05:03:50.328153 25661 tablet.cc:2369] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:03:50.354562 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.350935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41296 (local address 127.25.214.195:33595)
0807 05:03:50.351061 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:50.351065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:50.351080 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:03:50.351206 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:50.351208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:50.351261 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:50.351351 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:03:50.351597 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.352146 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.353083 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:50.353298 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:50.353385 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:50.353680 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:03:50.354166 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:03:50.354277 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:50.354343 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 05:03:50.354406 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:03:50.360996 25366 raft_consensus.cc:1261] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 1 FOLLOWER]: Refusing update from remote peer a76f0cba2ba54e27a05bacb93f869314: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:50.360996 25166 raft_consensus.cc:1261] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 1 FOLLOWER]: Refusing update from remote peer a76f0cba2ba54e27a05bacb93f869314: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:03:50.361855 25705 consensus_queue.cc:1035] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d34ab50d8eed4b5f9e4e41566d602772" member_type: VOTER last_known_addr { host: "127.25.214.193" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:50.362061 25700 consensus_queue.cc:1035] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b4a8f47cc4e4172a9bc606515e53b67" member_type: VOTER last_known_addr { host: "127.25.214.194" port: 36895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:03:50.370994 25711 mvcc.cc:205] Tried to move back new op lower bound from 7315779708350320640 to 7315779708129316864. Current Snapshot: MvccSnapshot[applied={T|T < 7315779708350320640}]
I20260807 05:03:50.379365 24931 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:50.379546 24931 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 05:03:50.382424 24931 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09448a927e564431b4f9f5fc929fd34f: Sending DeleteTablet for 3 replicas of tablet e973edd382664948bfe1fcf295ac8371
I20260807 05:03:50.383280 25340 tablet_service.cc:1514] Processing DeleteTablet for tablet e973edd382664948bfe1fcf295ac8371 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:50 UTC) from {username='slave'} at 127.0.0.1:48032
I20260807 05:03:50.383452 25127 tablet_service.cc:1514] Processing DeleteTablet for tablet e973edd382664948bfe1fcf295ac8371 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:50 UTC) from {username='slave'} at 127.0.0.1:51962
I20260807 05:03:50.383857 25550 tablet_service.cc:1514] Processing DeleteTablet for tablet e973edd382664948bfe1fcf295ac8371 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 05:03:50 UTC) from {username='slave'} at 127.0.0.1:41280
I20260807 05:03:50.384039 25724 tablet_replica.cc:330] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772: stopping tablet replica
I20260807 05:03:50.384440 25723 tablet_replica.cc:330] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: stopping tablet replica
I20260807 05:03:50.384632 25724 raft_consensus.cc:2229] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:50.384806 25723 raft_consensus.cc:2229] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 05:03:50.385102 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 25024
I20260807 05:03:50.385118 25724 raft_consensus.cc:2258] T e973edd382664948bfe1fcf295ac8371 P d34ab50d8eed4b5f9e4e41566d602772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:50.385177 25723 raft_consensus.cc:2258] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:50.385474 25727 tablet_replica.cc:330] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: stopping tablet replica
I20260807 05:03:50.385803 25727 raft_consensus.cc:2229] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 1 LEADER]: Raft consensus shutting down.
I20260807 05:03:50.386281 25727 raft_consensus.cc:2258] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 05:03:50.389173 25727 ts_tablet_manager.cc:1905] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:50.389724 25723 ts_tablet_manager.cc:1905] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 05:03:50.392198 25727 ts_tablet_manager.cc:1918] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:50.392285 25727 log.cc:1196] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-2/wal/wals/e973edd382664948bfe1fcf295ac8371
I20260807 05:03:50.392304 25723 ts_tablet_manager.cc:1918] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 05:03:50.392398 25723 log.cc:1196] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Deleting WAL directory at /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786078774062608-26459-0/minicluster-data/ts-1/wal/wals/e973edd382664948bfe1fcf295ac8371
I20260807 05:03:50.392597 25727 ts_tablet_manager.cc:1939] T e973edd382664948bfe1fcf295ac8371 P a76f0cba2ba54e27a05bacb93f869314: Deleting consensus metadata
I20260807 05:03:50.392696 25723 ts_tablet_manager.cc:1939] T e973edd382664948bfe1fcf295ac8371 P 1b4a8f47cc4e4172a9bc606515e53b67: Deleting consensus metadata
I20260807 05:03:50.393817 24915 catalog_manager.cc:4841] TS a76f0cba2ba54e27a05bacb93f869314 (127.25.214.195:33595): tablet e973edd382664948bfe1fcf295ac8371 (table test-table [id=78759482d11843209ede137b13a22b67]) successfully deleted
I20260807 05:03:50.394176 24913 catalog_manager.cc:4841] TS 1b4a8f47cc4e4172a9bc606515e53b67 (127.25.214.194:36895): tablet e973edd382664948bfe1fcf295ac8371 (table test-table [id=78759482d11843209ede137b13a22b67]) successfully deleted
W20260807 05:03:50.399627 24916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.214.193:33765 (error 108)
I20260807 05:03:50.400547 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 25246
I20260807 05:03:50.400784 25675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:50.400434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.193:33765 (local address 127.0.0.1:51964)
0807 05:03:50.400590 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 05:03:50.400672 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.193:33765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 05:03:50.407148 24916 catalog_manager.cc:4584] TS d34ab50d8eed4b5f9e4e41566d602772 (127.25.214.193:33765): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e973edd382664948bfe1fcf295ac8371: Network error: Client connection negotiation failed: client connection to 127.25.214.193:33765: connect: Connection refused (error 111)
I20260807 05:03:50.428942 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 25441
I20260807 05:03:50.441962 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 24894
2026-08-07T05:03:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1261 ms)
[----------] 6 tests from EncryptionPolicyTest (11109 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:50 dist-test-slave-lgr5 krb5kdc[25733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:50 dist-test-slave-lgr5 krb5kdc[25733](info): set up 2 sockets
Aug 07 05:03:50 dist-test-slave-lgr5 krb5kdc[25733](info): commencing operation
krb5kdc: starting...
W20260807 05:03:51.594720 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:51 dist-test-slave-lgr5 krb5kdc[25733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:03:51.721304 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34601
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:51.832504 25753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:51.832743 25753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:51.832800 25753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:51.836691 25753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:51.836745 25753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:51.836771 25753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:51.836800 25753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:51.836830 25753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:51.841960 25753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34601
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:51.843003 25753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:51.843992 25753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:51.851945 25760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:51.851969 25764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:51.852043 25753 server_base.cc:1034] running on GCE node
W20260807 05:03:51.851979 25767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:51.852721 25753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:51.853807 25753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:51.854971 25753 hybrid_clock.cc:648] HybridClock initialized: now 1786079031854952 us; error 33 us; skew 500 ppm
Aug 07 05:03:51 dist-test-slave-lgr5 krb5kdc[25733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079031, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:51.857724 25753 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:03:51.858554 25753 webserver.cc:460] Webserver started at http://127.0.0.1:40155/ using document root <none> and password file <none>
I20260807 05:03:51.859068 25753 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:51.859129 25753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:51.859329 25753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:51.861343 25753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "090376b11b6a4e179bb3e1b2ab3ac677"
format_stamp: "Formatted at 2026-08-07 05:03:51 on dist-test-slave-lgr5"
server_key: "226d0ddfb7a646d67959e9c0c4201655"
server_key_iv: "cf6a0ccf0b43c7d2a72ee6329652ce4d"
server_key_version: "encryptionkey@0"
I20260807 05:03:51.861878 25753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "090376b11b6a4e179bb3e1b2ab3ac677"
format_stamp: "Formatted at 2026-08-07 05:03:51 on dist-test-slave-lgr5"
server_key: "226d0ddfb7a646d67959e9c0c4201655"
server_key_iv: "cf6a0ccf0b43c7d2a72ee6329652ce4d"
server_key_version: "encryptionkey@0"
I20260807 05:03:51.865397 25753 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:51.867715 25775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:51.868891 25753 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:51.869066 25753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "090376b11b6a4e179bb3e1b2ab3ac677"
format_stamp: "Formatted at 2026-08-07 05:03:51 on dist-test-slave-lgr5"
server_key: "226d0ddfb7a646d67959e9c0c4201655"
server_key_iv: "cf6a0ccf0b43c7d2a72ee6329652ce4d"
server_key_version: "encryptionkey@0"
I20260807 05:03:51.869201 25753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:51.891680 25753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:51.894667 25753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:51.894869 25753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:51.901870 25753 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34601
I20260807 05:03:51.901898 25858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34601 every 8 connection(s)
I20260807 05:03:51.902861 25753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:51.905651 25859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:51.908370 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 25753
I20260807 05:03:51.908536 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:51.908849 26459 external_mini_cluster.cc:1428] Setting key 084727f59d8c6cfc5373c3eaee0a3c7f
I20260807 05:03:51.911696 25859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677: Bootstrap starting.
I20260807 05:03:51.913838 25859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:51.914685 25859 log.cc:824] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:51.916769 25859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677: No bootstrap required, opened a new log
Aug 07 05:03:51 dist-test-slave-lgr5 krb5kdc[25733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 05:03:51.920728 25859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 05:03:51.921005 25859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:51.921077 25859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 090376b11b6a4e179bb3e1b2ab3ac677, State: Initialized, Role: FOLLOWER
I20260807 05:03:51.921471 25859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 05:03:51.921619 25859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:51.921690 25859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:51.921792 25859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:51.922636 25859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 05:03:51.922906 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:51.910288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58867 (local address 127.0.0.1:34601)
0807 05:03:51.910739 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:51.910754 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:51.910789 (+ 35us) server_negotiation.cc:407] Connection header received
0807 05:03:51.911403 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:51.911420 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:51.911745 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:51.912065 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:51.912873 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:51.913851 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:51.914985 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:51.915481 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:51.915609 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:51.918357 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:51.918363 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:51.918375 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:51.918401 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:51.919990 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:51.920549 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:51.920554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:51.920558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:51.920664 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:51.920968 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:51.920970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:51.920971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:51.921429 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:51.921630 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:51.921940 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 05:03:51.922172 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":151,"threads_started":1}
I20260807 05:03:51.922946 25859 leader_election.cc:302] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 090376b11b6a4e179bb3e1b2ab3ac677; no voters:
I20260807 05:03:51.923229 25859 leader_election.cc:288] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:51.923350 25865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:51.923585 25865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [term 1 LEADER]: Becoming Leader. State: Replica: 090376b11b6a4e179bb3e1b2ab3ac677, State: Running, Role: LEADER
I20260807 05:03:51.923905 25865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 05:03:51.924429 25859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:51.925755 25866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } } }
I20260807 05:03:51.925879 25866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:51.926119 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:03:51.926211 25867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 090376b11b6a4e179bb3e1b2ab3ac677. Latest consensus state: current_term: 1 leader_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "090376b11b6a4e179bb3e1b2ab3ac677" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } } }
I20260807 05:03:51.926290 25867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:51.926551 25881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:51.929721 25881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:51.935637 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:51.928187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44775 (local address 127.0.0.1:34601)
0807 05:03:51.928289 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:51.928293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:51.928713 (+ 420us) server_negotiation.cc:407] Connection header received
0807 05:03:51.928812 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:51.928815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:51.928856 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:51.928920 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:51.929547 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:51.930095 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:51.930857 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:51.931089 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:51.931172 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:51.932484 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:51.932488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:51.932490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:51.932513 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:51.933756 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:51.934304 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:51.934308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:51.934309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:51.934397 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:51.934742 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:51.934745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:51.934747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:51.934950 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:51.935115 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:51.935396 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 05:03:51.935495 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 05:03:51.935657 25881 catalog_manager.cc:1347] Generated new cluster ID: a041b482dd3d4fc2bc7037087ba31a4a
I20260807 05:03:51.936097 25881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:51.944962 25881 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:51.946086 25881 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:51.949558 25881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 090376b11b6a4e179bb3e1b2ab3ac677: Generated new TSK 0
I20260807 05:03:51.950172 25881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:51.956869 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 25753
W20260807 05:03:51.971674 25729 connection.cc:535] client connection to 127.0.0.1:34601 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34601): Connection reset by peer (error 104)
2026-08-07T05:03:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1512 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:52 dist-test-slave-lgr5 krb5kdc[25912](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:52 dist-test-slave-lgr5 krb5kdc[25912](info): set up 2 sockets
Aug 07 05:03:52 dist-test-slave-lgr5 krb5kdc[25912](info): commencing operation
krb5kdc: starting...
W20260807 05:03:53.111923 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:53 dist-test-slave-lgr5 krb5kdc[25912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:03:53.238452 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43867
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:53.353847 25929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:53.354122 25929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:53.354182 25929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:53.358134 25929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:53.358201 25929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:53.358228 25929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:53.358248 25929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:53.358279 25929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:53.363668 25929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43867
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:53.364881 25929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:53.365947 25929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:53.374398 25940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:53.374384 25938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:53.374493 25929 server_base.cc:1034] running on GCE node
W20260807 05:03:53.374384 25936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:53.375211 25929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:53.376289 25929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:53.377437 25929 hybrid_clock.cc:648] HybridClock initialized: now 1786079033377422 us; error 39 us; skew 500 ppm
Aug 07 05:03:53 dist-test-slave-lgr5 krb5kdc[25912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079033, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:53.382992 25929 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:03:53.383890 25929 webserver.cc:460] Webserver started at http://127.0.0.1:34965/ using document root <none> and password file <none>
I20260807 05:03:53.384450 25929 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:53.384511 25929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:53.384708 25929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:53.386781 25929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "56ba6b09ec514260a21b5da01814f866"
format_stamp: "Formatted at 2026-08-07 05:03:53 on dist-test-slave-lgr5"
server_key: "16e11be1f948d8d40742602fe0676569"
server_key_iv: "a3e474985c04399d785d26df0e9c0cf0"
server_key_version: "encryptionkey@0"
I20260807 05:03:53.387302 25929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "56ba6b09ec514260a21b5da01814f866"
format_stamp: "Formatted at 2026-08-07 05:03:53 on dist-test-slave-lgr5"
server_key: "16e11be1f948d8d40742602fe0676569"
server_key_iv: "a3e474985c04399d785d26df0e9c0cf0"
server_key_version: "encryptionkey@0"
I20260807 05:03:53.390813 25929 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 05:03:53.393057 25950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:53.394191 25929 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:53.394297 25929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "56ba6b09ec514260a21b5da01814f866"
format_stamp: "Formatted at 2026-08-07 05:03:53 on dist-test-slave-lgr5"
server_key: "16e11be1f948d8d40742602fe0676569"
server_key_iv: "a3e474985c04399d785d26df0e9c0cf0"
server_key_version: "encryptionkey@0"
I20260807 05:03:53.394392 25929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:53.416020 25929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:53.418949 25929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:53.419145 25929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:53.425808 25929 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43867
I20260807 05:03:53.425848 26034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43867 every 8 connection(s)
I20260807 05:03:53.426757 25929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:53.429697 26037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:53.435335 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 25929
I20260807 05:03:53.435487 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:53.435775 26459 external_mini_cluster.cc:1428] Setting key 3ccb31cbd362f2fe2d684a05ca4d4f43
I20260807 05:03:53.436162 26037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866: Bootstrap starting.
I20260807 05:03:53.438722 26037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:53.439637 26037 log.cc:824] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:53.441901 26037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866: No bootstrap required, opened a new log
I20260807 05:03:53.445037 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:53.437296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43235 (local address 127.0.0.1:43867)
0807 05:03:53.437719 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:53.437735 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:53.437770 (+ 35us) server_negotiation.cc:407] Connection header received
0807 05:03:53.438411 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:53.438428 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:53.438777 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:53.439073 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:53.439478 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:53.440669 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:53.441846 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:53.442319 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:53.442433 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:53.443351 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:53.443356 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:53.443369 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:53.443749 (+ 380us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:53.443803 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:53.443825 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:53.443924 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:53.444161 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 05:03:53.444295 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":123,"threads_started":1}
I20260807 05:03:53.445927 26037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ba6b09ec514260a21b5da01814f866" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43867 } }
I20260807 05:03:53.446219 26037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:53.446285 26037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ba6b09ec514260a21b5da01814f866, State: Initialized, Role: FOLLOWER
I20260807 05:03:53.446758 26037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ba6b09ec514260a21b5da01814f866" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43867 } }
I20260807 05:03:53.446936 26037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:53.447067 26037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:53.447173 26037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:53.447994 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:03:53.448297 26037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ba6b09ec514260a21b5da01814f866" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43867 } }
I20260807 05:03:53.448644 26037 leader_election.cc:302] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56ba6b09ec514260a21b5da01814f866; no voters:
I20260807 05:03:53.448954 26037 leader_election.cc:288] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:53.449046 26044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:53.449293 26044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [term 1 LEADER]: Becoming Leader. State: Replica: 56ba6b09ec514260a21b5da01814f866, State: Running, Role: LEADER
I20260807 05:03:53.449662 26044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ba6b09ec514260a21b5da01814f866" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43867 } }
I20260807 05:03:53.450330 26037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:53.450886 26044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56ba6b09ec514260a21b5da01814f866. Latest consensus state: current_term: 1 leader_uuid: "56ba6b09ec514260a21b5da01814f866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ba6b09ec514260a21b5da01814f866" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43867 } } }
I20260807 05:03:53.451013 26044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:53.451285 26047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56ba6b09ec514260a21b5da01814f866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ba6b09ec514260a21b5da01814f866" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43867 } } }
I20260807 05:03:53.451390 26047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866 [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:53.454854 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:53.449988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42597 (local address 127.0.0.1:43867)
0807 05:03:53.450090 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:53.450093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:53.450318 (+ 225us) server_negotiation.cc:407] Connection header received
0807 05:03:53.450437 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:53.450440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:53.450480 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:53.450542 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:53.450834 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:53.451601 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:53.452924 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:53.453240 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:53.453317 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:53.454368 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:53.454372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:53.454374 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:53.454387 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:53.454410 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:53.454420 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:53.454490 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:53.454670 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 05:03:53.454706 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 05:03:53.455585 26068 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:03:53.455724 26068 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:03:53.455807 26054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:53.456669 26054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:53.462183 26054 catalog_manager.cc:1347] Generated new cluster ID: c1392fdb375247299e691b27ebadeb68
I20260807 05:03:53.462258 26054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:53.477200 26054 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:53.478178 26054 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:53.482749 26054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56ba6b09ec514260a21b5da01814f866: Generated new TSK 0
I20260807 05:03:53.483420 26054 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:53.489835 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 25929
W20260807 05:03:53.505201 25907 connection.cc:535] client connection to 127.0.0.1:43867 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43867): Connection reset by peer (error 104)
2026-08-07T05:03:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1533 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:53 dist-test-slave-lgr5 krb5kdc[26076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:53 dist-test-slave-lgr5 krb5kdc[26076](info): set up 2 sockets
Aug 07 05:03:53 dist-test-slave-lgr5 krb5kdc[26076](info): commencing operation
krb5kdc: starting...
W20260807 05:03:54.645013 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:54 dist-test-slave-lgr5 krb5kdc[26076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:03:54.769111 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:54.879959 26099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:54.880254 26099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:54.880299 26099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:54.884202 26099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:54.884258 26099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:54.884275 26099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:54.884290 26099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:54.884305 26099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:54.889477 26099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42927
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:54.890486 26099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:54.891465 26099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:54.899597 26107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:54.899740 26099 server_base.cc:1034] running on GCE node
W20260807 05:03:54.899694 26108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:54.899623 26112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:54.900421 26099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:54.901455 26099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:54.902580 26099 hybrid_clock.cc:648] HybridClock initialized: now 1786079034902559 us; error 31 us; skew 500 ppm
Aug 07 05:03:54 dist-test-slave-lgr5 krb5kdc[26076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079034, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:54.905174 26099 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:03:54.905994 26099 webserver.cc:460] Webserver started at http://127.0.0.1:42169/ using document root <none> and password file <none>
I20260807 05:03:54.906490 26099 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:54.906548 26099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:54.906715 26099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:54.908723 26099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "6ca5c4d972794fd5a6ef6101f74c212f"
format_stamp: "Formatted at 2026-08-07 05:03:54 on dist-test-slave-lgr5"
server_key: "0f0def52d2b685c18d4096a60bae09b2"
server_key_iv: "68920fe2dec893f2eb166a1d89e169b0"
server_key_version: "encryptionkey@0"
I20260807 05:03:54.909228 26099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "6ca5c4d972794fd5a6ef6101f74c212f"
format_stamp: "Formatted at 2026-08-07 05:03:54 on dist-test-slave-lgr5"
server_key: "0f0def52d2b685c18d4096a60bae09b2"
server_key_iv: "68920fe2dec893f2eb166a1d89e169b0"
server_key_version: "encryptionkey@0"
I20260807 05:03:54.912673 26099 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:54.914896 26128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:54.916141 26099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:54.916268 26099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "6ca5c4d972794fd5a6ef6101f74c212f"
format_stamp: "Formatted at 2026-08-07 05:03:54 on dist-test-slave-lgr5"
server_key: "0f0def52d2b685c18d4096a60bae09b2"
server_key_iv: "68920fe2dec893f2eb166a1d89e169b0"
server_key_version: "encryptionkey@0"
I20260807 05:03:54.916369 26099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:54.920785 26099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:54.923520 26099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:54.923673 26099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:54.930146 26099 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42927
I20260807 05:03:54.930190 26207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42927 every 8 connection(s)
I20260807 05:03:54.931012 26099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:54.933754 26211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:54.936002 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26099
I20260807 05:03:54.936156 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:54.936422 26459 external_mini_cluster.cc:1428] Setting key 2527c578f89cafeba76abc8c21842398
I20260807 05:03:54.939430 26211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f: Bootstrap starting.
I20260807 05:03:54.941282 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:54.937708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60469 (local address 127.0.0.1:42927)
0807 05:03:54.938163 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:54.938177 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:54.938211 (+ 34us) server_negotiation.cc:407] Connection header received
0807 05:03:54.938840 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:54.938856 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:54.939125 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:54.939416 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:54.940167 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:54.940173 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:54.940188 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:54.940198 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:54.940250 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:54.940269 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:54.940392 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:54.940462 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 05:03:54.940621 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":157,"threads_started":1}
I20260807 05:03:54.941833 26211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:54.942584 26211 log.cc:824] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:54.943816 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:03:54.944507 26211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f: No bootstrap required, opened a new log
I20260807 05:03:54.947207 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:54.945753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58543 (local address 127.0.0.1:42927)
0807 05:03:54.945875 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:54.945879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:54.945990 (+ 111us) server_negotiation.cc:407] Connection header received
0807 05:03:54.946083 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:54.946087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:54.946121 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:54.946207 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:54.946850 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:54.946854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:54.946856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:54.946869 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:54.946897 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:54.946911 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:54.947002 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:54.947050 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 05:03:54.947086 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:03:54.948745 26211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42927 } }
I20260807 05:03:54.949000 26211 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:54.949066 26211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca5c4d972794fd5a6ef6101f74c212f, State: Initialized, Role: FOLLOWER
I20260807 05:03:54.949470 26211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42927 } }
I20260807 05:03:54.949594 26211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:54.949638 26211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:54.949708 26211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:54.950678 26211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42927 } }
I20260807 05:03:54.951017 26211 leader_election.cc:302] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ca5c4d972794fd5a6ef6101f74c212f; no voters:
I20260807 05:03:54.951304 26211 leader_election.cc:288] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:54.951464 26226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:54.951812 26226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [term 1 LEADER]: Becoming Leader. State: Replica: 6ca5c4d972794fd5a6ef6101f74c212f, State: Running, Role: LEADER
I20260807 05:03:54.952239 26226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42927 } }
I20260807 05:03:54.952723 26211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:54.953877 26227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42927 } } }
I20260807 05:03:54.954010 26227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:54.954398 26235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:54.954358 26228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ca5c4d972794fd5a6ef6101f74c212f. Latest consensus state: current_term: 1 leader_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca5c4d972794fd5a6ef6101f74c212f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42927 } } }
I20260807 05:03:54.954627 26228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:54.957742 26235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:54.963826 26235 catalog_manager.cc:1347] Generated new cluster ID: 407800a324ec4b8588b748274b89c28a
I20260807 05:03:54.963904 26235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:54.984165 26235 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:54.984498 26235 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:54.989799 26235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ca5c4d972794fd5a6ef6101f74c212f: Generated new TSK 0
I20260807 05:03:54.990587 26235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:55.002556 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26099
2026-08-07T05:03:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:55 dist-test-slave-lgr5 krb5kdc[26254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:55 dist-test-slave-lgr5 krb5kdc[26254](info): set up 2 sockets
Aug 07 05:03:55 dist-test-slave-lgr5 krb5kdc[26254](info): commencing operation
krb5kdc: starting...
W20260807 05:03:56.170262 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:56 dist-test-slave-lgr5 krb5kdc[26254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:03:56.289263 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40833
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40833
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:56.399398 26274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:56.399639 26274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:56.399693 26274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:56.403582 26274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:56.403645 26274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:56.403672 26274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:56.403693 26274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:56.403718 26274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:56.408867 26274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40833
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:56.409899 26274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:56.410892 26274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:56.419294 26282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:56.419314 26280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:56.419309 26279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:56.419414 26274 server_base.cc:1034] running on GCE node
I20260807 05:03:56.420161 26274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:56.421275 26274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:56.422449 26274 hybrid_clock.cc:648] HybridClock initialized: now 1786079036422435 us; error 25 us; skew 500 ppm
Aug 07 05:03:56 dist-test-slave-lgr5 krb5kdc[26254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079036, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:56.425082 26274 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:03:56.425930 26274 webserver.cc:460] Webserver started at http://127.0.0.1:41345/ using document root <none> and password file <none>
I20260807 05:03:56.426472 26274 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:56.426537 26274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:56.426739 26274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:56.428781 26274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "1a3674aa3a80408cad8147710850a1de"
format_stamp: "Formatted at 2026-08-07 05:03:56 on dist-test-slave-lgr5"
server_key: "4f39c93096175729471bfc7d195fe3d0"
server_key_iv: "800a4a2b8e206a6600e6dfaca116081c"
server_key_version: "encryptionkey@0"
I20260807 05:03:56.429301 26274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "1a3674aa3a80408cad8147710850a1de"
format_stamp: "Formatted at 2026-08-07 05:03:56 on dist-test-slave-lgr5"
server_key: "4f39c93096175729471bfc7d195fe3d0"
server_key_iv: "800a4a2b8e206a6600e6dfaca116081c"
server_key_version: "encryptionkey@0"
I20260807 05:03:56.432713 26274 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:03:56.434866 26292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:56.436028 26274 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:56.436179 26274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "1a3674aa3a80408cad8147710850a1de"
format_stamp: "Formatted at 2026-08-07 05:03:56 on dist-test-slave-lgr5"
server_key: "4f39c93096175729471bfc7d195fe3d0"
server_key_iv: "800a4a2b8e206a6600e6dfaca116081c"
server_key_version: "encryptionkey@0"
I20260807 05:03:56.436268 26274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:56.449735 26274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:56.452145 26274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:56.452296 26274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:56.458602 26274 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40833
I20260807 05:03:56.458631 26381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40833 every 8 connection(s)
I20260807 05:03:56.459452 26274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:56.462069 26383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:56.465839 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26274
I20260807 05:03:56.465991 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:56.466269 26459 external_mini_cluster.cc:1428] Setting key 6513e31abc3d7d036d31d6573375c9fa
I20260807 05:03:56.467691 26383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de: Bootstrap starting.
I20260807 05:03:56.470402 26383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:56.471359 26383 log.cc:824] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:56.473394 26383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de: No bootstrap required, opened a new log
Aug 07 05:03:56 dist-test-slave-lgr5 krb5kdc[26254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 05:03:56.477403 26383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a3674aa3a80408cad8147710850a1de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40833 } }
I20260807 05:03:56.477659 26383 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:56.477721 26383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3674aa3a80408cad8147710850a1de, State: Initialized, Role: FOLLOWER
I20260807 05:03:56.478179 26383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a3674aa3a80408cad8147710850a1de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40833 } }
I20260807 05:03:56.478319 26383 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:56.478389 26383 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:56.478492 26383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:56.479429 26383 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a3674aa3a80408cad8147710850a1de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40833 } }
I20260807 05:03:56.479805 26383 leader_election.cc:302] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a3674aa3a80408cad8147710850a1de; no voters:
I20260807 05:03:56.480223 26383 leader_election.cc:288] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:56.480336 26392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:56.480588 26392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [term 1 LEADER]: Becoming Leader. State: Replica: 1a3674aa3a80408cad8147710850a1de, State: Running, Role: LEADER
I20260807 05:03:56.480998 26392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a3674aa3a80408cad8147710850a1de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40833 } }
I20260807 05:03:56.481238 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:56.467692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49183 (local address 127.0.0.1:40833)
0807 05:03:56.468155 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:56.468180 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:56.468222 (+ 42us) server_negotiation.cc:407] Connection header received
0807 05:03:56.469060 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:56.469084 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:56.469499 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:56.469855 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:56.470642 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:56.472010 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:56.472876 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:56.473342 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:56.473487 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:56.475991 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:56.475996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:56.476011 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:56.476039 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:56.477736 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:56.478268 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:56.478275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:56.478281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:56.478446 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:56.478726 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:56.478730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:56.478732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:56.479160 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:56.479361 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:56.479714 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 05:03:56.480060 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":140,"threads_started":1}
I20260807 05:03:56.481632 26383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:56.482802 26394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a3674aa3a80408cad8147710850a1de. Latest consensus state: current_term: 1 leader_uuid: "1a3674aa3a80408cad8147710850a1de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a3674aa3a80408cad8147710850a1de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40833 } } }
I20260807 05:03:56.483011 26394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:56.482985 26398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a3674aa3a80408cad8147710850a1de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a3674aa3a80408cad8147710850a1de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40833 } } }
I20260807 05:03:56.483126 26398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:56.483654 26408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:56.484997 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:03:56.487805 26408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:56.494570 26408 catalog_manager.cc:1347] Generated new cluster ID: d2d95759bc254adc872ee47b7576492b
I20260807 05:03:56.494655 26408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:56.496946 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:56.487615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41793 (local address 127.0.0.1:40833)
0807 05:03:56.487749 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:56.487755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:56.488035 (+ 280us) server_negotiation.cc:407] Connection header received
0807 05:03:56.488299 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:56.488303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:56.488359 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:56.488416 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:56.489414 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:56.490253 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:56.491357 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:56.491721 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:56.491839 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:56.493442 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:56.493446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:56.493449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:03:56.493477 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:56.495220 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:56.495696 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:56.495700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:56.495702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:56.495791 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:03:56.496034 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:03:56.496037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:03:56.496039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:03:56.496288 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:56.496432 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:56.496655 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 05:03:56.496784 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 05:03:56.514065 26408 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:56.515362 26408 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:56.523917 26408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a3674aa3a80408cad8147710850a1de: Generated new TSK 0
I20260807 05:03:56.524799 26408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:56.531481 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26274
2026-08-07T05:03:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:56 dist-test-slave-lgr5 krb5kdc[26432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:56 dist-test-slave-lgr5 krb5kdc[26432](info): set up 2 sockets
Aug 07 05:03:56 dist-test-slave-lgr5 krb5kdc[26432](info): commencing operation
krb5kdc: starting...
W20260807 05:03:57.673460 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:57 dist-test-slave-lgr5 krb5kdc[26432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:03:57.792955 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:57.900558 26451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:57.900823 26451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:57.900883 26451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:57.904848 26451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:57.904902 26451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:57.904928 26451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:57.904951 26451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:57.904980 26451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:57.910109 26451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:57.911085 26451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:57.912046 26451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:57.920441 26467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:57.920599 26451 server_base.cc:1034] running on GCE node
W20260807 05:03:57.920467 26470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:57.920460 26468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:57.921306 26451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:57.922456 26451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:57.923617 26451 hybrid_clock.cc:648] HybridClock initialized: now 1786079037923601 us; error 29 us; skew 500 ppm
Aug 07 05:03:57 dist-test-slave-lgr5 krb5kdc[26432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079037, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:57.926252 26451 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:03:57.927124 26451 webserver.cc:460] Webserver started at http://127.0.0.1:44273/ using document root <none> and password file <none>
I20260807 05:03:57.927646 26451 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:57.927704 26451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:57.927875 26451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:57.929945 26451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "e41456d0155443819ce9ba8f0956144e"
format_stamp: "Formatted at 2026-08-07 05:03:57 on dist-test-slave-lgr5"
server_key: "3d825aab4d89b0fcf12ac9e0108bfa66"
server_key_iv: "bdca33b6fdfb9569ec46b6b2c073ee2b"
server_key_version: "encryptionkey@0"
I20260807 05:03:57.930473 26451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "e41456d0155443819ce9ba8f0956144e"
format_stamp: "Formatted at 2026-08-07 05:03:57 on dist-test-slave-lgr5"
server_key: "3d825aab4d89b0fcf12ac9e0108bfa66"
server_key_iv: "bdca33b6fdfb9569ec46b6b2c073ee2b"
server_key_version: "encryptionkey@0"
I20260807 05:03:57.934099 26451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 05:03:57.936401 26482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:57.937601 26451 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:03:57.937731 26451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "e41456d0155443819ce9ba8f0956144e"
format_stamp: "Formatted at 2026-08-07 05:03:57 on dist-test-slave-lgr5"
server_key: "3d825aab4d89b0fcf12ac9e0108bfa66"
server_key_iv: "bdca33b6fdfb9569ec46b6b2c073ee2b"
server_key_version: "encryptionkey@0"
I20260807 05:03:57.937844 26451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:57.959414 26451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:57.962471 26451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:57.962672 26451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:57.969760 26451 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34317
I20260807 05:03:57.969774 26559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34317 every 8 connection(s)
I20260807 05:03:57.970736 26451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:57.974278 26560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:57.978988 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26451
I20260807 05:03:57.979156 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:57.979451 26459 external_mini_cluster.cc:1428] Setting key 17a8708167a39ad6db00e3ca3aa1d04c
I20260807 05:03:57.981113 26560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e: Bootstrap starting.
I20260807 05:03:57.983352 26560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:57.984098 26560 log.cc:824] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:57.985890 26560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e: No bootstrap required, opened a new log
I20260807 05:03:57.988381 26563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:57.981028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36497 (local address 127.0.0.1:34317)
0807 05:03:57.981494 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:57.981509 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:57.981546 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:03:57.982178 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:57.982195 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:57.982529 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:57.982828 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:57.983244 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:57.984317 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:57.985174 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:57.985639 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:57.985784 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:57.986681 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:57.986687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:57.986700 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:57.987092 (+ 392us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:57.987150 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:57.987173 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:57.987261 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:57.987409 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 05:03:57.987615 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":144,"threads_started":1}
I20260807 05:03:57.989766 26560 raft_consensus.cc:348] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e41456d0155443819ce9ba8f0956144e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260807 05:03:57.989987 26560 raft_consensus.cc:374] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:57.990043 26560 raft_consensus.cc:729] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e41456d0155443819ce9ba8f0956144e, State: Initialized, Role: FOLLOWER
I20260807 05:03:57.990473 26560 consensus_queue.cc:260] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e41456d0155443819ce9ba8f0956144e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260807 05:03:57.990636 26560 raft_consensus.cc:388] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:57.990708 26560 raft_consensus.cc:482] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:57.990808 26560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:57.991216 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:03:57.991758 26560 raft_consensus.cc:504] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e41456d0155443819ce9ba8f0956144e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260807 05:03:57.992074 26560 leader_election.cc:302] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e41456d0155443819ce9ba8f0956144e; no voters:
I20260807 05:03:57.992406 26560 leader_election.cc:288] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:57.992527 26566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:57.992702 26566 raft_consensus.cc:686] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [term 1 LEADER]: Becoming Leader. State: Replica: e41456d0155443819ce9ba8f0956144e, State: Running, Role: LEADER
I20260807 05:03:57.992996 26566 consensus_queue.cc:237] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e41456d0155443819ce9ba8f0956144e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260807 05:03:57.993675 26560 sys_catalog.cc:564] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:57.994565 26575 sys_catalog.cc:455] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e41456d0155443819ce9ba8f0956144e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e41456d0155443819ce9ba8f0956144e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } } }
I20260807 05:03:57.994712 26575 sys_catalog.cc:458] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:57.995018 26577 sys_catalog.cc:455] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e41456d0155443819ce9ba8f0956144e. Latest consensus state: current_term: 1 leader_uuid: "e41456d0155443819ce9ba8f0956144e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e41456d0155443819ce9ba8f0956144e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } } }
I20260807 05:03:57.995111 26577 sys_catalog.cc:458] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:57.997978 26563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:57.993296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46995 (local address 127.0.0.1:34317)
0807 05:03:57.993559 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:57.993563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:57.993795 (+ 232us) server_negotiation.cc:407] Connection header received
0807 05:03:57.993954 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:57.993957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:57.994004 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:57.994071 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:57.994466 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:57.995188 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:57.996413 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:03:57.996640 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:03:57.996717 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:03:57.997545 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:57.997549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:57.997552 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:57.997565 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:57.997595 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:57.997607 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:57.997685 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:57.997780 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 05:03:57.997833 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
W20260807 05:03:57.998689 26599 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:03:57.998770 26599 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:03:57.998847 26590 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:57.999529 26590 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:58.005051 26590 catalog_manager.cc:1347] Generated new cluster ID: 0766a55d44be4bd69c416dc4a59f0960
I20260807 05:03:58.005116 26590 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:58.019865 26590 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:58.020880 26590 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:58.025553 26590 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e41456d0155443819ce9ba8f0956144e: Generated new TSK 0
I20260807 05:03:58.026201 26590 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:58.030000 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26451
2026-08-07T05:03:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1498 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:58 dist-test-slave-lgr5 krb5kdc[26607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:58 dist-test-slave-lgr5 krb5kdc[26607](info): set up 2 sockets
Aug 07 05:03:58 dist-test-slave-lgr5 krb5kdc[26607](info): commencing operation
krb5kdc: starting...
W20260807 05:03:59.194217 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:03:59 dist-test-slave-lgr5 krb5kdc[26607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:03:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:03:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:03:59.319005 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44561
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:03:59.433159 26623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:03:59.433444 26623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:03:59.433502 26623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:03:59.437561 26623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:03:59.437625 26623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:03:59.437651 26623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:03:59.437674 26623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:03:59.437703 26623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:03:59.443055 26623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:03:59.444192 26623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:03:59.445191 26623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:03:59.453567 26628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:03:59.453583 26633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:59.453706 26623 server_base.cc:1034] running on GCE node
W20260807 05:03:59.453583 26630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:03:59.454411 26623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:03:59.455587 26623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:03:59.456745 26623 hybrid_clock.cc:648] HybridClock initialized: now 1786079039456724 us; error 33 us; skew 500 ppm
Aug 07 05:03:59 dist-test-slave-lgr5 krb5kdc[26607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079039, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:03:59.463667 26623 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:03:59.464753 26623 webserver.cc:460] Webserver started at http://127.0.0.1:39663/ using document root <none> and password file <none>
I20260807 05:03:59.465385 26623 fs_manager.cc:359] Metadata directory not provided
I20260807 05:03:59.465463 26623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:03:59.465693 26623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:03:59.467890 26623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "3f111916fd1d48fab11b68391d7e034b"
format_stamp: "Formatted at 2026-08-07 05:03:59 on dist-test-slave-lgr5"
server_key: "7667ed8827ebfc4a2b3ce2772e1cd94c"
server_key_iv: "3a0713503e9dfa2545142876185306c1"
server_key_version: "encryptionkey@0"
I20260807 05:03:59.468539 26623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "3f111916fd1d48fab11b68391d7e034b"
format_stamp: "Formatted at 2026-08-07 05:03:59 on dist-test-slave-lgr5"
server_key: "7667ed8827ebfc4a2b3ce2772e1cd94c"
server_key_iv: "3a0713503e9dfa2545142876185306c1"
server_key_version: "encryptionkey@0"
I20260807 05:03:59.472929 26623 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:03:59.475558 26646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:03:59.476905 26623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:03:59.477051 26623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "3f111916fd1d48fab11b68391d7e034b"
format_stamp: "Formatted at 2026-08-07 05:03:59 on dist-test-slave-lgr5"
server_key: "7667ed8827ebfc4a2b3ce2772e1cd94c"
server_key_iv: "3a0713503e9dfa2545142876185306c1"
server_key_version: "encryptionkey@0"
I20260807 05:03:59.477161 26623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:03:59.481803 26623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:03:59.484755 26623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:03:59.484949 26623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:03:59.491668 26623 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44561
I20260807 05:03:59.491719 26731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44561 every 8 connection(s)
I20260807 05:03:59.492666 26623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:03:59.495451 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:03:59.495954 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26623
I20260807 05:03:59.496130 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:03:59.496440 26459 external_mini_cluster.cc:1428] Setting key 5c4dc7a20dc1d6600116c85d0436f366
I20260807 05:03:59.502121 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:59.497864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43053 (local address 127.0.0.1:44561)
0807 05:03:59.498325 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:59.498343 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:59.498389 (+ 46us) server_negotiation.cc:407] Connection header received
0807 05:03:59.499201 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:59.499224 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:59.499591 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:59.499949 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:59.500737 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:59.500743 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:59.500758 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:59.500769 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:59.500832 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:59.500859 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:59.501012 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:59.501085 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 05:03:59.501239 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":130,"threads_started":1}
I20260807 05:03:59.502246 26732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b: Bootstrap starting.
I20260807 05:03:59.504801 26732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b: Neither blocks nor log segments found. Creating new log.
I20260807 05:03:59.505023 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:03:59.505550 26732 log.cc:824] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b: Log is configured to *not* fsync() on all Append() calls
I20260807 05:03:59.507715 26732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b: No bootstrap required, opened a new log
I20260807 05:03:59.508723 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:03:59.507109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52039 (local address 127.0.0.1:44561)
0807 05:03:59.507207 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 05:03:59.507212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:03:59.507431 (+ 219us) server_negotiation.cc:407] Connection header received
0807 05:03:59.507543 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:03:59.507546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:03:59.507579 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:03:59.507644 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:03:59.508349 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:03:59.508352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:03:59.508355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:03:59.508368 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:03:59.508394 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:03:59.508405 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:03:59.508487 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 05:03:59.508564 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 05:03:59.508604 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 05:03:59.511577 26732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f111916fd1d48fab11b68391d7e034b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44561 } }
I20260807 05:03:59.511842 26732 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:03:59.511880 26732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f111916fd1d48fab11b68391d7e034b, State: Initialized, Role: FOLLOWER
I20260807 05:03:59.512321 26732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f111916fd1d48fab11b68391d7e034b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44561 } }
I20260807 05:03:59.512466 26732 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:03:59.512517 26732 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:03:59.512605 26732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:03:59.513695 26732 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f111916fd1d48fab11b68391d7e034b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44561 } }
I20260807 05:03:59.514053 26732 leader_election.cc:302] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f111916fd1d48fab11b68391d7e034b; no voters:
I20260807 05:03:59.514389 26732 leader_election.cc:288] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:03:59.514479 26744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:03:59.514714 26744 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [term 1 LEADER]: Becoming Leader. State: Replica: 3f111916fd1d48fab11b68391d7e034b, State: Running, Role: LEADER
I20260807 05:03:59.515098 26744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f111916fd1d48fab11b68391d7e034b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44561 } }
I20260807 05:03:59.515702 26732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:03:59.516826 26746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f111916fd1d48fab11b68391d7e034b. Latest consensus state: current_term: 1 leader_uuid: "3f111916fd1d48fab11b68391d7e034b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f111916fd1d48fab11b68391d7e034b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44561 } } }
I20260807 05:03:59.516963 26746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:59.517279 26745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f111916fd1d48fab11b68391d7e034b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f111916fd1d48fab11b68391d7e034b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44561 } } }
I20260807 05:03:59.517354 26755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:03:59.517379 26745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b [sys.catalog]: This master's current role is: LEADER
I20260807 05:03:59.520643 26755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:03:59.527041 26755 catalog_manager.cc:1347] Generated new cluster ID: e21c039e1263465d862e3b3cc876bc7c
I20260807 05:03:59.527122 26755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:03:59.538355 26755 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:03:59.538679 26755 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:03:59.545674 26755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f111916fd1d48fab11b68391d7e034b: Generated new TSK 0
I20260807 05:03:59.546331 26755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:03:59.556341 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26623
2026-08-07T05:03:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:03:59 dist-test-slave-lgr5 krb5kdc[26782](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:03:59 dist-test-slave-lgr5 krb5kdc[26782](info): set up 2 sockets
Aug 07 05:03:59 dist-test-slave-lgr5 krb5kdc[26782](info): commencing operation
krb5kdc: starting...
W20260807 05:04:00.711323 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:00 dist-test-slave-lgr5 krb5kdc[26782](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:04:00.838683 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40919
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:00.953780 26800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:00.954088 26800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:00.954154 26800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:00.958253 26800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:00.958345 26800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:00.958377 26800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:00.958405 26800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:00.958436 26800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:00.963868 26800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:00.965058 26800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:00.966145 26800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:00.975327 26807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:00.975327 26808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:00.975324 26810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:00.975387 26800 server_base.cc:1034] running on GCE node
I20260807 05:04:00.976253 26800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:00.977411 26800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:00.978580 26800 hybrid_clock.cc:648] HybridClock initialized: now 1786079040978568 us; error 31 us; skew 500 ppm
Aug 07 05:04:00 dist-test-slave-lgr5 krb5kdc[26782](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079040, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:00.981352 26800 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:04:00.982359 26800 webserver.cc:460] Webserver started at http://127.0.0.1:41375/ using document root <none> and password file <none>
I20260807 05:04:00.982913 26800 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:00.982982 26800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:00.983189 26800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:00.985617 26800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "1345119cd0604c2393b733c2271391a5"
format_stamp: "Formatted at 2026-08-07 05:04:00 on dist-test-slave-lgr5"
server_key: "6b4d9f34ed73f8cade5b671d2fe62a6e"
server_key_iv: "4ed68e315d325415f2621e338c47f77e"
server_key_version: "encryptionkey@0"
I20260807 05:04:00.986191 26800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "1345119cd0604c2393b733c2271391a5"
format_stamp: "Formatted at 2026-08-07 05:04:00 on dist-test-slave-lgr5"
server_key: "6b4d9f34ed73f8cade5b671d2fe62a6e"
server_key_iv: "4ed68e315d325415f2621e338c47f77e"
server_key_version: "encryptionkey@0"
I20260807 05:04:00.990056 26800 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:04:00.992502 26820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:00.993708 26800 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:04:00.993813 26800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "1345119cd0604c2393b733c2271391a5"
format_stamp: "Formatted at 2026-08-07 05:04:00 on dist-test-slave-lgr5"
server_key: "6b4d9f34ed73f8cade5b671d2fe62a6e"
server_key_iv: "4ed68e315d325415f2621e338c47f77e"
server_key_version: "encryptionkey@0"
I20260807 05:04:00.993899 26800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:01.026120 26800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:01.028878 26800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:01.029047 26800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:01.035882 26800 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40919
I20260807 05:04:01.035907 26896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40919 every 8 connection(s)
I20260807 05:04:01.036820 26800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:01.039529 26897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:01.045137 26897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5: Bootstrap starting.
I20260807 05:04:01.046082 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26800
I20260807 05:04:01.046241 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:01.046566 26459 external_mini_cluster.cc:1428] Setting key 4167b51ec759d2e0f4714d3705cc0044
I20260807 05:04:01.047973 26897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:01.048746 26897 log.cc:824] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:01.050784 26897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5: No bootstrap required, opened a new log
I20260807 05:04:01.054580 26897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1345119cd0604c2393b733c2271391a5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260807 05:04:01.054795 26897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:01.054850 26897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1345119cd0604c2393b733c2271391a5, State: Initialized, Role: FOLLOWER
Aug 07 05:04:01 dist-test-slave-lgr5 krb5kdc[26782](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 05:04:01.055291 26897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1345119cd0604c2393b733c2271391a5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260807 05:04:01.055414 26897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:01.055483 26897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:01.055572 26897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:01.056533 26897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1345119cd0604c2393b733c2271391a5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260807 05:04:01.056877 26897 leader_election.cc:302] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1345119cd0604c2393b733c2271391a5; no voters:
I20260807 05:04:01.057160 26897 leader_election.cc:288] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:01.057245 26902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:01.057451 26902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [term 1 LEADER]: Becoming Leader. State: Replica: 1345119cd0604c2393b733c2271391a5, State: Running, Role: LEADER
I20260807 05:04:01.057794 26902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1345119cd0604c2393b733c2271391a5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260807 05:04:01.058497 26897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:01.059441 26903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1345119cd0604c2393b733c2271391a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1345119cd0604c2393b733c2271391a5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } } }
I20260807 05:04:01.059837 26903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:01.059721 26904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1345119cd0604c2393b733c2271391a5. Latest consensus state: current_term: 1 leader_uuid: "1345119cd0604c2393b733c2271391a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1345119cd0604c2393b733c2271391a5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } } }
I20260807 05:04:01.060114 26904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:01.061194 26915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:01.061898 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:01.047625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:36739 (local address 127.0.0.1:40919)
0807 05:04:01.047994 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:01.048009 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:01.048052 (+ 43us) server_negotiation.cc:407] Connection header received
0807 05:04:01.048730 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:01.048747 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:01.049112 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:01.049381 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:01.050128 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:01.051550 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:01.052439 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:01.053138 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:01.053305 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:01.055736 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:01.055741 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:01.055754 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:01.055781 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:01.057487 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:01.058106 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:01.058111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:01.058116 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:01.058223 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:01.058617 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:01.058620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:01.058621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:01.059101 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:01.060076 (+ 975us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:01.060662 (+ 586us) server_negotiation.cc:299] Negotiation successful
0807 05:04:01.060918 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":91,"threads_started":1}
I20260807 05:04:01.064541 26915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:01.064949 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:01.070497 26915 catalog_manager.cc:1347] Generated new cluster ID: a88b770ac86e42d383611f384f30da93
I20260807 05:04:01.070570 26915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:01.077174 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:01.068510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:40817 (local address 127.0.0.1:40919)
0807 05:04:01.068651 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:01.068655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:01.068669 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:04:01.068704 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:01.068707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:01.068751 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:01.068828 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:01.069653 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:01.070473 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:01.071672 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:01.072019 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:01.072146 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:01.073833 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:01.073836 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:01.073839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:01.073863 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:01.075427 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:01.075926 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:01.075929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:01.075930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:01.076002 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:01.076326 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:01.076329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:01.076331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:01.076514 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:01.076654 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:01.076897 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 05:04:01.076987 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 05:04:01.089680 26915 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:01.090692 26915 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:01.100205 26915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1345119cd0604c2393b733c2271391a5: Generated new TSK 0
I20260807 05:04:01.100895 26915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:01.106349 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26800
W20260807 05:04:01.120286 26780 connection.cc:535] client connection to 127.0.0.1:40919 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40919): Connection reset by peer (error 104)
2026-08-07T05:04:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1549 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:01 dist-test-slave-lgr5 krb5kdc[26941](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:01 dist-test-slave-lgr5 krb5kdc[26941](info): set up 2 sockets
Aug 07 05:04:01 dist-test-slave-lgr5 krb5kdc[26941](info): commencing operation
krb5kdc: starting...
W20260807 05:04:02.270038 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:02 dist-test-slave-lgr5 krb5kdc[26941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:04:02.399353 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37765
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:02.511653 26962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:02.511914 26962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:02.511982 26962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:02.515889 26962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:02.515954 26962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:02.515985 26962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:02.516021 26962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:02.516054 26962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:02.521189 26962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:02.522176 26962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:02.523241 26962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:04:02.531466 26962 server_base.cc:1034] running on GCE node
W20260807 05:04:02.531430 26974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:02.531428 26982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:02.531423 26975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:02.532249 26962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:02.533279 26962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:02.534464 26962 hybrid_clock.cc:648] HybridClock initialized: now 1786079042534445 us; error 28 us; skew 500 ppm
Aug 07 05:04:02 dist-test-slave-lgr5 krb5kdc[26941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079042, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:02.537297 26962 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:04:02.538203 26962 webserver.cc:460] Webserver started at http://127.0.0.1:40171/ using document root <none> and password file <none>
I20260807 05:04:02.538735 26962 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:02.538797 26962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:02.539011 26962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:02.541138 26962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689"
format_stamp: "Formatted at 2026-08-07 05:04:02 on dist-test-slave-lgr5"
server_key: "9b9705b3fbdca8214a5e2b5c2e705cfb"
server_key_iv: "2f57db9eb0dbea843113624f2f402175"
server_key_version: "encryptionkey@0"
I20260807 05:04:02.541688 26962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689"
format_stamp: "Formatted at 2026-08-07 05:04:02 on dist-test-slave-lgr5"
server_key: "9b9705b3fbdca8214a5e2b5c2e705cfb"
server_key_iv: "2f57db9eb0dbea843113624f2f402175"
server_key_version: "encryptionkey@0"
I20260807 05:04:02.545446 26962 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:04:02.547902 26992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:02.549168 26962 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:04:02.549306 26962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689"
format_stamp: "Formatted at 2026-08-07 05:04:02 on dist-test-slave-lgr5"
server_key: "9b9705b3fbdca8214a5e2b5c2e705cfb"
server_key_iv: "2f57db9eb0dbea843113624f2f402175"
server_key_version: "encryptionkey@0"
I20260807 05:04:02.549407 26962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:02.568907 26962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:02.571640 26962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:02.571825 26962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:02.579396 26962 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37765
I20260807 05:04:02.579416 27075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37765 every 8 connection(s)
I20260807 05:04:02.580372 26962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:02.583076 27076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:02.585760 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 26962
I20260807 05:04:02.585917 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:02.586237 26459 external_mini_cluster.cc:1428] Setting key b1bd2f99d1f6820b60740176045a76d1
I20260807 05:04:02.589062 27076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689: Bootstrap starting.
I20260807 05:04:02.591480 27076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:02.592288 27076 log.cc:824] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:02.594386 27076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689: No bootstrap required, opened a new log
I20260807 05:04:02.594933 27080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:02.587531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:35893 (local address 127.0.0.1:37765)
0807 05:04:02.587937 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:02.587952 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:02.587986 (+ 34us) server_negotiation.cc:407] Connection header received
0807 05:04:02.588641 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:02.588658 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:02.588990 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:02.589287 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:02.589636 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:02.590584 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:02.591722 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:02.592229 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:02.592343 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:02.593288 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:02.593293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:02.593306 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:02.593677 (+ 371us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:02.593729 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:02.593752 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:02.593851 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:02.594034 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 05:04:02.594177 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260807 05:04:02.597983 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:02.598263 27076 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37765 } }
I20260807 05:04:02.598531 27076 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:02.598589 27076 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a10ce22e3e4f5fa1b6e223c6c42689, State: Initialized, Role: FOLLOWER
I20260807 05:04:02.599081 27076 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37765 } }
I20260807 05:04:02.599252 27076 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:02.599328 27076 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:02.599488 27076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:02.600582 27076 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37765 } }
I20260807 05:04:02.600955 27076 leader_election.cc:302] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1a10ce22e3e4f5fa1b6e223c6c42689; no voters:
I20260807 05:04:02.601293 27076 leader_election.cc:288] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:02.601382 27092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:02.601593 27092 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [term 1 LEADER]: Becoming Leader. State: Replica: e1a10ce22e3e4f5fa1b6e223c6c42689, State: Running, Role: LEADER
I20260807 05:04:02.601946 27092 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37765 } }
I20260807 05:04:02.602495 27076 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:02.603152 27092 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1a10ce22e3e4f5fa1b6e223c6c42689. Latest consensus state: current_term: 1 leader_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37765 } } }
I20260807 05:04:02.603775 27093 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a10ce22e3e4f5fa1b6e223c6c42689" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37765 } } }
I20260807 05:04:02.603896 27092 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:02.604013 27093 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:02.605367 27080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:02.600252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:49895 (local address 127.0.0.1:37765)
0807 05:04:02.600374 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:02.600378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:02.600555 (+ 177us) server_negotiation.cc:407] Connection header received
0807 05:04:02.600635 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:02.600638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:02.600695 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:02.600777 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:02.601007 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:02.601780 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:02.602863 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:02.603214 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:02.603319 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:02.604399 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:02.604403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:02.604405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:02.604417 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:02.604444 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:02.604456 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:02.604559 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:02.605203 (+ 644us) server_negotiation.cc:299] Negotiation successful
0807 05:04:02.605239 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":47}
W20260807 05:04:02.607272 27119 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:02.607338 27119 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:02.607456 27112 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:02.608409 27112 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:02.614357 27112 catalog_manager.cc:1347] Generated new cluster ID: 701939fe7cd5435fa790c9c181204366
I20260807 05:04:02.614434 27112 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:02.644969 27112 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:02.645987 27112 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:02.656494 27112 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1a10ce22e3e4f5fa1b6e223c6c42689: Generated new TSK 0
I20260807 05:04:02.657378 27112 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:02.670740 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 26962
W20260807 05:04:02.686285 26936 connection.cc:535] client connection to 127.0.0.1:37765 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37765): Connection reset by peer (error 104)
2026-08-07T05:04:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1565 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:02 dist-test-slave-lgr5 krb5kdc[27129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:02 dist-test-slave-lgr5 krb5kdc[27129](info): set up 2 sockets
Aug 07 05:04:02 dist-test-slave-lgr5 krb5kdc[27129](info): commencing operation
krb5kdc: starting...
W20260807 05:04:03.823383 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:03 dist-test-slave-lgr5 krb5kdc[27129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:04:03.947166 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45915
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:04.061576 27150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:04.061856 27150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:04.061896 27150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:04.065811 27150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:04.065861 27150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:04.065878 27150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:04.065893 27150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:04.065907 27150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:04.071441 27150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:04.072503 27150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:04.073494 27150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:04.081787 27160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:04.081828 27150 server_base.cc:1034] running on GCE node
W20260807 05:04:04.081754 27157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:04.081758 27158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:04.082453 27150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:04.083504 27150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:04.084650 27150 hybrid_clock.cc:648] HybridClock initialized: now 1786079044084630 us; error 34 us; skew 500 ppm
Aug 07 05:04:04 dist-test-slave-lgr5 krb5kdc[27129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079044, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:04.087185 27150 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:04:04.088025 27150 webserver.cc:460] Webserver started at http://127.0.0.1:35223/ using document root <none> and password file <none>
I20260807 05:04:04.088567 27150 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:04.088631 27150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:04.088810 27150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:04.090754 27150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "1062a6a7582d4206a0e2631ed758d2e0"
format_stamp: "Formatted at 2026-08-07 05:04:04 on dist-test-slave-lgr5"
server_key: "8301df94ae24f65afc35ef6eac00589b"
server_key_iv: "66362792b544ffd334697b75a8df460c"
server_key_version: "encryptionkey@0"
I20260807 05:04:04.091284 27150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "1062a6a7582d4206a0e2631ed758d2e0"
format_stamp: "Formatted at 2026-08-07 05:04:04 on dist-test-slave-lgr5"
server_key: "8301df94ae24f65afc35ef6eac00589b"
server_key_iv: "66362792b544ffd334697b75a8df460c"
server_key_version: "encryptionkey@0"
I20260807 05:04:04.094749 27150 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 05:04:04.097121 27171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:04.098287 27150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:04:04.098408 27150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "1062a6a7582d4206a0e2631ed758d2e0"
format_stamp: "Formatted at 2026-08-07 05:04:04 on dist-test-slave-lgr5"
server_key: "8301df94ae24f65afc35ef6eac00589b"
server_key_iv: "66362792b544ffd334697b75a8df460c"
server_key_version: "encryptionkey@0"
I20260807 05:04:04.098507 27150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:04.102847 27150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:04.105460 27150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:04.105619 27150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:04.112072 27150 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45915
I20260807 05:04:04.112119 27254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45915 every 8 connection(s)
I20260807 05:04:04.113014 27150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:04.113561 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27150
I20260807 05:04:04.113708 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:04.113961 26459 external_mini_cluster.cc:1428] Setting key a92bf5be840edc70d61fc544862a72b1
I20260807 05:04:04.116264 27255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:04.119181 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:04.115468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:36557 (local address 127.0.0.1:45915)
0807 05:04:04.115909 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:04.115924 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:04.115961 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:04:04.116673 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:04.116694 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:04.116977 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:04.117290 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:04.118053 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:04.118057 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:04.118068 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:04.118078 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:04.118137 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:04.118156 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:04.118284 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:04.118360 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 05:04:04.118510 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":141,"threads_started":1}
I20260807 05:04:04.122143 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:04.122498 27255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0: Bootstrap starting.
I20260807 05:04:04.124912 27255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:04.125586 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:04.124067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:55561 (local address 127.0.0.1:45915)
0807 05:04:04.124191 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:04.124195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:04.124340 (+ 145us) server_negotiation.cc:407] Connection header received
0807 05:04:04.124449 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:04.124451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:04.124479 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:04.124554 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:04.125231 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:04.125234 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:04.125236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:04.125246 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:04.125269 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:04.125278 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:04.125341 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:04.125430 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 05:04:04.125459 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 05:04:04.125804 27255 log.cc:824] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:04.127792 27255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0: No bootstrap required, opened a new log
I20260807 05:04:04.131300 27255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1062a6a7582d4206a0e2631ed758d2e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45915 } }
I20260807 05:04:04.131516 27255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:04.131551 27255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1062a6a7582d4206a0e2631ed758d2e0, State: Initialized, Role: FOLLOWER
I20260807 05:04:04.131910 27255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1062a6a7582d4206a0e2631ed758d2e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45915 } }
I20260807 05:04:04.132020 27255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:04.132063 27255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:04.132189 27255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:04.133011 27255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1062a6a7582d4206a0e2631ed758d2e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45915 } }
I20260807 05:04:04.133299 27255 leader_election.cc:302] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1062a6a7582d4206a0e2631ed758d2e0; no voters:
I20260807 05:04:04.133562 27255 leader_election.cc:288] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:04.133659 27271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:04.133844 27271 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [term 1 LEADER]: Becoming Leader. State: Replica: 1062a6a7582d4206a0e2631ed758d2e0, State: Running, Role: LEADER
I20260807 05:04:04.134131 27271 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1062a6a7582d4206a0e2631ed758d2e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45915 } }
I20260807 05:04:04.134887 27255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:04.135756 27273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1062a6a7582d4206a0e2631ed758d2e0. Latest consensus state: current_term: 1 leader_uuid: "1062a6a7582d4206a0e2631ed758d2e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1062a6a7582d4206a0e2631ed758d2e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45915 } } }
I20260807 05:04:04.135886 27273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:04.136235 27282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:04.136253 27272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1062a6a7582d4206a0e2631ed758d2e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1062a6a7582d4206a0e2631ed758d2e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45915 } } }
I20260807 05:04:04.136469 27272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:04.139002 27282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:04.144433 27282 catalog_manager.cc:1347] Generated new cluster ID: d0382d317ac34a2da4319648150fcf3a
I20260807 05:04:04.144500 27282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:04.158124 27282 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:04.158488 27282 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:04.168844 27282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1062a6a7582d4206a0e2631ed758d2e0: Generated new TSK 0
I20260807 05:04:04.169705 27282 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:04.174388 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27150
2026-08-07T05:04:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1506 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:04 dist-test-slave-lgr5 krb5kdc[27299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:04 dist-test-slave-lgr5 krb5kdc[27299](info): set up 2 sockets
Aug 07 05:04:04 dist-test-slave-lgr5 krb5kdc[27299](info): commencing operation
krb5kdc: starting...
W20260807 05:04:05.320590 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:05 dist-test-slave-lgr5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:04:05.447100 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36001
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36001
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:05.560408 27324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:05.560663 27324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:05.560720 27324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:05.564610 27324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:05.564664 27324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:05.564690 27324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:05.564710 27324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:05.564738 27324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:05.569892 27324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36001
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:05.570904 27324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:05.571924 27324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:05.580274 27330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:05.580225 27329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:05.580484 27324 server_base.cc:1034] running on GCE node
W20260807 05:04:05.580219 27334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:05.581143 27324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:05.582248 27324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:05.583410 27324 hybrid_clock.cc:648] HybridClock initialized: now 1786079045583387 us; error 39 us; skew 500 ppm
Aug 07 05:04:05 dist-test-slave-lgr5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079045, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:05.589838 27324 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:04:05.590797 27324 webserver.cc:460] Webserver started at http://127.0.0.1:35101/ using document root <none> and password file <none>
I20260807 05:04:05.591372 27324 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:05.591441 27324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:05.591656 27324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:05.593855 27324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "cd85167d45d844dab68496fc80ac81c8"
format_stamp: "Formatted at 2026-08-07 05:04:05 on dist-test-slave-lgr5"
server_key: "51a2dc984def29371670a5baf9c7ec81"
server_key_iv: "c4928e94bdc34cdfc9f65bccc400ad8f"
server_key_version: "encryptionkey@0"
I20260807 05:04:05.594409 27324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "cd85167d45d844dab68496fc80ac81c8"
format_stamp: "Formatted at 2026-08-07 05:04:05 on dist-test-slave-lgr5"
server_key: "51a2dc984def29371670a5baf9c7ec81"
server_key_iv: "c4928e94bdc34cdfc9f65bccc400ad8f"
server_key_version: "encryptionkey@0"
I20260807 05:04:05.598160 27324 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 05:04:05.600538 27344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:05.601730 27324 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:04:05.601850 27324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "cd85167d45d844dab68496fc80ac81c8"
format_stamp: "Formatted at 2026-08-07 05:04:05 on dist-test-slave-lgr5"
server_key: "51a2dc984def29371670a5baf9c7ec81"
server_key_iv: "c4928e94bdc34cdfc9f65bccc400ad8f"
server_key_version: "encryptionkey@0"
I20260807 05:04:05.601943 27324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:05.617851 27324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:05.620966 27324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:05.621153 27324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:05.627874 27324 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36001
I20260807 05:04:05.627926 27420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36001 every 8 connection(s)
I20260807 05:04:05.628877 27324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:05.631680 27421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:05.633875 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27324
I20260807 05:04:05.634007 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:05.634258 26459 external_mini_cluster.cc:1428] Setting key 7b88f6b267c5031d3c5a8f90d3edc6ab
I20260807 05:04:05.637969 27421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8: Bootstrap starting.
I20260807 05:04:05.640558 27421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:05.641443 27421 log.cc:824] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:05.643420 27421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8: No bootstrap required, opened a new log
Aug 07 05:04:05 dist-test-slave-lgr5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 05:04:05.647774 27421 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd85167d45d844dab68496fc80ac81c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260807 05:04:05.648070 27421 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:05.648160 27421 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd85167d45d844dab68496fc80ac81c8, State: Initialized, Role: FOLLOWER
I20260807 05:04:05.648638 27421 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd85167d45d844dab68496fc80ac81c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260807 05:04:05.648794 27421 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:05.648861 27421 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:05.648967 27421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:05.649147 27424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:05.635608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:56867 (local address 127.0.0.1:36001)
0807 05:04:05.636019 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:05.636039 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:05.636109 (+ 70us) server_negotiation.cc:407] Connection header received
0807 05:04:05.636895 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:05.636919 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:05.637335 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:05.637700 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:05.638390 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:05.639850 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:05.640703 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:05.641386 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:05.641553 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:05.644109 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:05.644116 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:05.644132 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:05.644163 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:05.646050 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:05.646521 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:05.646527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:05.646534 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:05.646676 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:05.646946 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:05.646949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:05.646951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:05.647470 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:05.647695 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:05.647898 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 05:04:05.648153 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":104,"threads_started":1}
I20260807 05:04:05.649950 27421 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd85167d45d844dab68496fc80ac81c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260807 05:04:05.650303 27421 leader_election.cc:302] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd85167d45d844dab68496fc80ac81c8; no voters:
I20260807 05:04:05.650638 27421 leader_election.cc:288] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:05.650740 27429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:05.650955 27429 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [term 1 LEADER]: Becoming Leader. State: Replica: cd85167d45d844dab68496fc80ac81c8, State: Running, Role: LEADER
I20260807 05:04:05.651322 27429 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd85167d45d844dab68496fc80ac81c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260807 05:04:05.651908 27421 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:05.652448 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:05.653139 27433 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd85167d45d844dab68496fc80ac81c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd85167d45d844dab68496fc80ac81c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } } }
I20260807 05:04:05.653139 27437 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd85167d45d844dab68496fc80ac81c8. Latest consensus state: current_term: 1 leader_uuid: "cd85167d45d844dab68496fc80ac81c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd85167d45d844dab68496fc80ac81c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } } }
I20260807 05:04:05.653285 27433 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:05.653285 27437 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:05.653726 27448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:05.657262 27448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:05.663141 27448 catalog_manager.cc:1347] Generated new cluster ID: 91ba7bcc6bae48e1851cd46c1b7071d3
I20260807 05:04:05.663287 27448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:05.664497 27424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:05.654692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:35265 (local address 127.0.0.1:36001)
0807 05:04:05.654795 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:05.654799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:05.655885 (+ 1086us) server_negotiation.cc:407] Connection header received
0807 05:04:05.656105 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:05.656109 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:05.656163 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:05.656217 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:05.656958 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:05.657495 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:05.658290 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:05.658537 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:05.658626 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:05.660224 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:05.660228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:05.660231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:05.660259 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:05.662269 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:05.662921 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:05.662924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:05.662926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:05.663018 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:05.663425 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:05.663428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:05.663430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:05.663678 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:05.663831 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:05.664227 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 05:04:05.664336 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:04:05.674579 27448 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:05.675921 27448 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:05.683609 27448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd85167d45d844dab68496fc80ac81c8: Generated new TSK 0
I20260807 05:04:05.684484 27448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:05.691334 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27324
W20260807 05:04:05.705415 27296 connection.cc:535] client connection to 127.0.0.1:36001 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36001): Connection reset by peer (error 104)
2026-08-07T05:04:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1512 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:05 dist-test-slave-lgr5 krb5kdc[27478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:05 dist-test-slave-lgr5 krb5kdc[27478](info): set up 2 sockets
Aug 07 05:04:05 dist-test-slave-lgr5 krb5kdc[27478](info): commencing operation
krb5kdc: starting...
W20260807 05:04:06.845475 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:06 dist-test-slave-lgr5 krb5kdc[27478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:04:06.964026 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39349
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:07.074836 27502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:07.075089 27502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:07.075134 27502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:07.079124 27502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:07.079177 27502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:07.079197 27502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:07.079213 27502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:07.079226 27502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:07.084283 27502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39349
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:07.085245 27502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:07.086227 27502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:07.094616 27510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:07.094666 27502 server_base.cc:1034] running on GCE node
W20260807 05:04:07.094616 27511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:07.094619 27513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:07.095455 27502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:07.096776 27502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:07.097978 27502 hybrid_clock.cc:648] HybridClock initialized: now 1786079047097957 us; error 37 us; skew 500 ppm
Aug 07 05:04:07 dist-test-slave-lgr5 krb5kdc[27478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079047, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:07.101071 27502 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:04:07.102138 27502 webserver.cc:460] Webserver started at http://127.0.0.1:38969/ using document root <none> and password file <none>
I20260807 05:04:07.102748 27502 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:07.102826 27502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:07.103045 27502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:07.105286 27502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "d77060ebf790421c8077743b437709dd"
format_stamp: "Formatted at 2026-08-07 05:04:07 on dist-test-slave-lgr5"
server_key: "8dbf098de4318a892a3af7ee057f14e9"
server_key_iv: "89b796f3deb0128b9fb4376430da5144"
server_key_version: "encryptionkey@0"
I20260807 05:04:07.105890 27502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "d77060ebf790421c8077743b437709dd"
format_stamp: "Formatted at 2026-08-07 05:04:07 on dist-test-slave-lgr5"
server_key: "8dbf098de4318a892a3af7ee057f14e9"
server_key_iv: "89b796f3deb0128b9fb4376430da5144"
server_key_version: "encryptionkey@0"
I20260807 05:04:07.109771 27502 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:04:07.112056 27523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:07.113237 27502 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 05:04:07.113358 27502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "d77060ebf790421c8077743b437709dd"
format_stamp: "Formatted at 2026-08-07 05:04:07 on dist-test-slave-lgr5"
server_key: "8dbf098de4318a892a3af7ee057f14e9"
server_key_iv: "89b796f3deb0128b9fb4376430da5144"
server_key_version: "encryptionkey@0"
I20260807 05:04:07.113451 27502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:07.151680 27502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:07.154678 27502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:07.154867 27502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:07.162073 27502 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39349
I20260807 05:04:07.162099 27603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39349 every 8 connection(s)
I20260807 05:04:07.163049 27502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:07.165891 27604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:07.171339 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27502
I20260807 05:04:07.171504 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:07.171794 26459 external_mini_cluster.cc:1428] Setting key a79523a7ce1ba0a30010ddc42f553ec3
I20260807 05:04:07.172523 27604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd: Bootstrap starting.
I20260807 05:04:07.175187 27604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:07.175974 27604 log.cc:824] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:07.178037 27604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd: No bootstrap required, opened a new log
I20260807 05:04:07.181293 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:07.173426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:35467 (local address 127.0.0.1:39349)
0807 05:04:07.173916 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:07.173933 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:07.173970 (+ 37us) server_negotiation.cc:407] Connection header received
0807 05:04:07.174664 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:07.174683 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:07.175077 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:07.175417 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:07.175868 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:07.176945 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:07.177877 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:07.178391 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:07.178555 (+ 164us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:07.179564 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:07.179569 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:07.179583 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:07.179999 (+ 416us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:07.180059 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:07.180118 (+ 59us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:07.180239 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:07.180425 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 05:04:07.180562 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":141,"threads_started":1}
I20260807 05:04:07.181871 27604 raft_consensus.cc:348] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77060ebf790421c8077743b437709dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39349 } }
I20260807 05:04:07.182103 27604 raft_consensus.cc:374] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:07.182193 27604 raft_consensus.cc:729] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d77060ebf790421c8077743b437709dd, State: Initialized, Role: FOLLOWER
I20260807 05:04:07.182655 27604 consensus_queue.cc:260] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77060ebf790421c8077743b437709dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39349 } }
I20260807 05:04:07.182782 27604 raft_consensus.cc:388] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:07.182864 27604 raft_consensus.cc:482] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:07.182964 27604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:07.183964 27604 raft_consensus.cc:504] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77060ebf790421c8077743b437709dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39349 } }
I20260807 05:04:07.184007 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:07.184290 27604 leader_election.cc:302] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d77060ebf790421c8077743b437709dd; no voters:
I20260807 05:04:07.184595 27604 leader_election.cc:288] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:07.184698 27609 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:07.184923 27609 raft_consensus.cc:686] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [term 1 LEADER]: Becoming Leader. State: Replica: d77060ebf790421c8077743b437709dd, State: Running, Role: LEADER
I20260807 05:04:07.185395 27609 consensus_queue.cc:237] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77060ebf790421c8077743b437709dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39349 } }
I20260807 05:04:07.185814 27604 sys_catalog.cc:564] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:07.187071 27612 sys_catalog.cc:455] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d77060ebf790421c8077743b437709dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77060ebf790421c8077743b437709dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39349 } } }
I20260807 05:04:07.187197 27612 sys_catalog.cc:458] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:07.187579 27610 sys_catalog.cc:455] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d77060ebf790421c8077743b437709dd. Latest consensus state: current_term: 1 leader_uuid: "d77060ebf790421c8077743b437709dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77060ebf790421c8077743b437709dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39349 } } }
I20260807 05:04:07.187713 27610 sys_catalog.cc:458] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:07.188015 27636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:07.191620 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:07.186079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:35505 (local address 127.0.0.1:39349)
0807 05:04:07.186183 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:07.186187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:07.186619 (+ 432us) server_negotiation.cc:407] Connection header received
0807 05:04:07.186798 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:07.186801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:07.186853 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:07.186919 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:07.187345 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:07.188105 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:07.189243 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:07.189598 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:07.189704 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:07.191003 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:07.191008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:07.191010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:07.191024 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:07.191051 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:07.191065 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:07.191145 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:07.191462 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 05:04:07.191498 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 05:04:07.191779 27636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:07.197221 27636 catalog_manager.cc:1347] Generated new cluster ID: 533e177d94eb4cb0924ff5bab1609ec4
I20260807 05:04:07.197291 27636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:07.213922 27636 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:07.214818 27636 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:07.219873 27636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d77060ebf790421c8077743b437709dd: Generated new TSK 0
I20260807 05:04:07.220532 27636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:07.227388 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27502
W20260807 05:04:07.245754 27470 connection.cc:535] client connection to 127.0.0.1:39349 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39349): Connection reset by peer (error 104)
2026-08-07T05:04:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:07 dist-test-slave-lgr5 krb5kdc[27655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:07 dist-test-slave-lgr5 krb5kdc[27655](info): set up 2 sockets
Aug 07 05:04:07 dist-test-slave-lgr5 krb5kdc[27655](info): commencing operation
krb5kdc: starting...
W20260807 05:04:08.430960 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:08 dist-test-slave-lgr5 krb5kdc[27655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 05:04:08.555344 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42627
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:08.666895 27676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:08.667140 27676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:08.667198 27676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:08.671131 27676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:08.671206 27676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:08.671231 27676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:08.671253 27676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:08.671283 27676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:08.676795 27676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:08.677929 27676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:08.678970 27676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:08.687529 27684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:08.687599 27676 server_base.cc:1034] running on GCE node
W20260807 05:04:08.687529 27683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:08.687595 27687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:08.688416 27676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:08.689529 27676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:08.690686 27676 hybrid_clock.cc:648] HybridClock initialized: now 1786079048690670 us; error 30 us; skew 500 ppm
Aug 07 05:04:08 dist-test-slave-lgr5 krb5kdc[27655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079048, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:08.693308 27676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 05:04:08.694154 27676 webserver.cc:460] Webserver started at http://127.0.0.1:36409/ using document root <none> and password file <none>
I20260807 05:04:08.694669 27676 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:08.694725 27676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:08.694895 27676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:08.697024 27676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "5ad43764daea4e0d95180ad63a658af9"
format_stamp: "Formatted at 2026-08-07 05:04:08 on dist-test-slave-lgr5"
server_key: "d7c3d6f003539755591cd62da413d250"
server_key_iv: "97d7372fb106dce6e21034d8c2fc3416"
server_key_version: "encryptionkey@0"
I20260807 05:04:08.697592 27676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "5ad43764daea4e0d95180ad63a658af9"
format_stamp: "Formatted at 2026-08-07 05:04:08 on dist-test-slave-lgr5"
server_key: "d7c3d6f003539755591cd62da413d250"
server_key_iv: "97d7372fb106dce6e21034d8c2fc3416"
server_key_version: "encryptionkey@0"
I20260807 05:04:08.701716 27676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 05:04:08.704170 27696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:08.705399 27676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:04:08.705515 27676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "5ad43764daea4e0d95180ad63a658af9"
format_stamp: "Formatted at 2026-08-07 05:04:08 on dist-test-slave-lgr5"
server_key: "d7c3d6f003539755591cd62da413d250"
server_key_iv: "97d7372fb106dce6e21034d8c2fc3416"
server_key_version: "encryptionkey@0"
I20260807 05:04:08.705628 27676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:08.710623 27676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:08.713558 27676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:08.713733 27676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:08.720808 27676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42627
I20260807 05:04:08.720860 27774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42627 every 8 connection(s)
I20260807 05:04:08.721756 27676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:08.722097 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27676
I20260807 05:04:08.722241 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:08.722560 26459 external_mini_cluster.cc:1428] Setting key fde9fcda2979bd7f7336fc078e39f87a
I20260807 05:04:08.725188 27775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:08.727991 27781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:08.723916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:47235 (local address 127.0.0.1:42627)
0807 05:04:08.724354 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:08.724372 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:08.724415 (+ 43us) server_negotiation.cc:407] Connection header received
0807 05:04:08.725244 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:08.725270 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:08.725618 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:08.725972 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:08.726621 (+ 649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:08.726626 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:08.726640 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:08.726650 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:08.726710 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:08.726736 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:08.726872 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:08.726940 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 05:04:08.727102 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":140,"threads_started":1}
I20260807 05:04:08.730752 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:08.731874 27775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9: Bootstrap starting.
I20260807 05:04:08.734705 27781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:08.733105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:43877 (local address 127.0.0.1:42627)
0807 05:04:08.733217 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:08.733221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:08.733397 (+ 176us) server_negotiation.cc:407] Connection header received
0807 05:04:08.733488 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:08.733490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:08.733527 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:08.733606 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:08.734319 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:08.734323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:08.734325 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:08.734338 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:08.734366 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:08.734378 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:08.734466 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:08.734539 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 05:04:08.734581 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 05:04:08.734726 27775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:08.735589 27775 log.cc:824] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:08.737659 27775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9: No bootstrap required, opened a new log
I20260807 05:04:08.741367 27775 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad43764daea4e0d95180ad63a658af9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42627 } }
I20260807 05:04:08.741611 27775 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:08.741662 27775 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad43764daea4e0d95180ad63a658af9, State: Initialized, Role: FOLLOWER
I20260807 05:04:08.742064 27775 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad43764daea4e0d95180ad63a658af9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42627 } }
I20260807 05:04:08.742187 27775 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:08.742245 27775 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:08.742338 27775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:08.743261 27775 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad43764daea4e0d95180ad63a658af9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42627 } }
I20260807 05:04:08.743590 27775 leader_election.cc:302] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ad43764daea4e0d95180ad63a658af9; no voters:
I20260807 05:04:08.743884 27775 leader_election.cc:288] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:08.744040 27795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:08.744354 27795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5ad43764daea4e0d95180ad63a658af9, State: Running, Role: LEADER
I20260807 05:04:08.744700 27795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad43764daea4e0d95180ad63a658af9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42627 } }
I20260807 05:04:08.745148 27775 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:08.746555 27796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ad43764daea4e0d95180ad63a658af9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad43764daea4e0d95180ad63a658af9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42627 } } }
I20260807 05:04:08.746775 27799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ad43764daea4e0d95180ad63a658af9. Latest consensus state: current_term: 1 leader_uuid: "5ad43764daea4e0d95180ad63a658af9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad43764daea4e0d95180ad63a658af9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42627 } } }
I20260807 05:04:08.746894 27796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:08.746922 27799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9 [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:08.747376 27813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:08.750881 27813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:08.756829 27813 catalog_manager.cc:1347] Generated new cluster ID: daf7bbc6b589489fa1cc839578c11eee
I20260807 05:04:08.756898 27813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:08.792511 27813 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:08.792843 27813 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:08.801322 27813 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ad43764daea4e0d95180ad63a658af9: Generated new TSK 0
I20260807 05:04:08.801999 27813 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:08.806593 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27676
2026-08-07T05:04:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1575 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:08 dist-test-slave-lgr5 krb5kdc[27829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:08 dist-test-slave-lgr5 krb5kdc[27829](info): set up 2 sockets
Aug 07 05:04:08 dist-test-slave-lgr5 krb5kdc[27829](info): commencing operation
krb5kdc: starting...
W20260807 05:04:09.955756 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:10 dist-test-slave-lgr5 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:10.076647 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:39541
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:39541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:10.190251 27845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:10.190532 27845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:10.190575 27845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:10.194567 27845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:10.194648 27845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:10.194669 27845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:10.194687 27845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:10.194705 27845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:10.199957 27845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:39541
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:39541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:10.200994 27845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:10.201972 27845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:10.210300 27853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:10.210390 27845 server_base.cc:1034] running on GCE node
W20260807 05:04:10.210292 27858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:10.210328 27854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:10.211047 27845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:10.212041 27845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:10.213231 27845 hybrid_clock.cc:648] HybridClock initialized: now 1786079050213214 us; error 32 us; skew 500 ppm
Aug 07 05:04:10 dist-test-slave-lgr5 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079050, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:10.215798 27845 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:10.216673 27845 webserver.cc:460] Webserver started at http://127.25.214.254:46581/ using document root <none> and password file <none>
I20260807 05:04:10.217196 27845 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:10.217262 27845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:10.217447 27845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:10.219425 27845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "f539dc2d322443239a11fea17158ce5e"
format_stamp: "Formatted at 2026-08-07 05:04:10 on dist-test-slave-lgr5"
server_key: "10259198ba43e74cc99196dd1f1a9d75"
server_key_iv: "bcd697d1e7409e46138e23174fe30a0f"
server_key_version: "encryptionkey@0"
I20260807 05:04:10.219950 27845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "f539dc2d322443239a11fea17158ce5e"
format_stamp: "Formatted at 2026-08-07 05:04:10 on dist-test-slave-lgr5"
server_key: "10259198ba43e74cc99196dd1f1a9d75"
server_key_iv: "bcd697d1e7409e46138e23174fe30a0f"
server_key_version: "encryptionkey@0"
I20260807 05:04:10.223457 27845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 05:04:10.225697 27870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:10.226792 27845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 05:04:10.226917 27845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "f539dc2d322443239a11fea17158ce5e"
format_stamp: "Formatted at 2026-08-07 05:04:10 on dist-test-slave-lgr5"
server_key: "10259198ba43e74cc99196dd1f1a9d75"
server_key_iv: "bcd697d1e7409e46138e23174fe30a0f"
server_key_version: "encryptionkey@0"
I20260807 05:04:10.227010 27845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:10.240546 27845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:10.243177 27845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:10.243346 27845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:10.249816 27845 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:39541
I20260807 05:04:10.249861 27949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:39541 every 8 connection(s)
I20260807 05:04:10.250707 27845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:10.252871 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 27845
I20260807 05:04:10.252997 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:10.253253 26459 external_mini_cluster.cc:1428] Setting key 3a0fbbb29069cd66e3bbbcf73530b75f
I20260807 05:04:10.253407 27950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:10.260440 27950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e: Bootstrap starting.
Aug 07 05:04:10 dist-test-slave-lgr5 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:04:10.262748 27950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:10.263612 27950 log.cc:824] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:10.265810 27950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e: No bootstrap required, opened a new log
I20260807 05:04:10.268514 27954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:10.254565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55301 (local address 127.25.214.254:39541)
0807 05:04:10.254980 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:10.254998 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:10.255038 (+ 40us) server_negotiation.cc:407] Connection header received
0807 05:04:10.256032 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:10.256055 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:10.256495 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:10.256857 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:10.257562 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:10.259007 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:10.259874 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:10.260596 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:10.260751 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:10.263092 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:10.263098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:10.263115 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:10.263147 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:10.265411 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:10.265895 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:10.265900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:10.265906 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:10.266039 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:10.266348 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:10.266351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:10.266353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:10.266848 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:10.267041 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:10.267295 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 05:04:10.267516 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":109,"threads_started":1}
I20260807 05:04:10.270226 27950 raft_consensus.cc:348] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f539dc2d322443239a11fea17158ce5e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39541 } }
I20260807 05:04:10.270504 27950 raft_consensus.cc:374] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:10.270567 27950 raft_consensus.cc:729] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f539dc2d322443239a11fea17158ce5e, State: Initialized, Role: FOLLOWER
I20260807 05:04:10.270992 27950 consensus_queue.cc:260] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f539dc2d322443239a11fea17158ce5e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39541 } }
I20260807 05:04:10.271160 27950 raft_consensus.cc:388] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:10.271226 27950 raft_consensus.cc:482] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:10.271329 27950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:10.271458 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:10.272471 27950 raft_consensus.cc:504] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f539dc2d322443239a11fea17158ce5e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39541 } }
I20260807 05:04:10.272840 27950 leader_election.cc:302] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f539dc2d322443239a11fea17158ce5e; no voters:
I20260807 05:04:10.273175 27950 leader_election.cc:288] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:10.273258 27963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:10.273479 27963 raft_consensus.cc:686] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [term 1 LEADER]: Becoming Leader. State: Replica: f539dc2d322443239a11fea17158ce5e, State: Running, Role: LEADER
I20260807 05:04:10.273856 27963 consensus_queue.cc:237] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f539dc2d322443239a11fea17158ce5e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39541 } }
I20260807 05:04:10.274425 27950 sys_catalog.cc:564] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:10.275357 27964 sys_catalog.cc:455] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f539dc2d322443239a11fea17158ce5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f539dc2d322443239a11fea17158ce5e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39541 } } }
I20260807 05:04:10.275477 27964 sys_catalog.cc:458] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:10.275712 27964 sys_catalog.cc:455] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f539dc2d322443239a11fea17158ce5e. Latest consensus state: current_term: 1 leader_uuid: "f539dc2d322443239a11fea17158ce5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f539dc2d322443239a11fea17158ce5e" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39541 } } }
I20260807 05:04:10.275786 27964 sys_catalog.cc:458] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:10.276185 27980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:10.280313 27980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:10.283210 27954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:10.273675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59489 (local address 127.25.214.254:39541)
0807 05:04:10.273787 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:10.273791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:10.274167 (+ 376us) server_negotiation.cc:407] Connection header received
0807 05:04:10.274357 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:10.274360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:10.274403 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:10.274454 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:10.275464 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:10.276266 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:10.277414 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:10.277659 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:10.277744 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:10.279413 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:10.279417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:10.279420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:10.279450 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:10.281107 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:10.281700 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:10.281703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:10.281705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:10.281793 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:10.282181 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:10.282185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:10.282187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:10.282409 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:10.282530 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:10.282948 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 05:04:10.283052 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 05:04:10.286919 27980 catalog_manager.cc:1347] Generated new cluster ID: 3b1e3e6409654676b04248e760bebd19
I20260807 05:04:10.286983 27980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:10.315073 27980 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:10.316355 27980 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:10.329025 27980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f539dc2d322443239a11fea17158ce5e: Generated new TSK 0
I20260807 05:04:10.329818 27980 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:10.339691 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 27845
W20260807 05:04:10.353857 27827 connection.cc:535] client connection to 127.25.214.254:39541 recv error: Network error: failed to read from TLS socket (remote: 127.25.214.254:39541): Connection reset by peer (error 104)
2026-08-07T05:04:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1532 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:10 dist-test-slave-lgr5 krb5kdc[28002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:10 dist-test-slave-lgr5 krb5kdc[28002](info): set up 2 sockets
Aug 07 05:04:10 dist-test-slave-lgr5 krb5kdc[28002](info): commencing operation
krb5kdc: starting...
W20260807 05:04:11.493067 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:11 dist-test-slave-lgr5 krb5kdc[28002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:11.615329 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:41749
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:45427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:41749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:11.731544 28027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:11.731894 28027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:11.731967 28027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:11.735993 28027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:11.736059 28027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:11.736104 28027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:11.736128 28027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:11.736158 28027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:11.741485 28027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:45427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:41749
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:41749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:11.742660 28027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:11.743731 28027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:04:11.751992 28027 server_base.cc:1034] running on GCE node
W20260807 05:04:11.752125 28040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:11.752030 28036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:11.751991 28037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:11.752751 28027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:11.753765 28027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:11.754920 28027 hybrid_clock.cc:648] HybridClock initialized: now 1786079051754904 us; error 26 us; skew 500 ppm
Aug 07 05:04:11 dist-test-slave-lgr5 krb5kdc[28002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079051, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:11.761102 28027 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:11.762028 28027 webserver.cc:460] Webserver started at http://127.25.214.254:33027/ using document root <none> and password file <none>
I20260807 05:04:11.762583 28027 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:11.762647 28027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:11.762857 28027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:11.765002 28027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "f06249c914e145a3809e899a25eb01db"
format_stamp: "Formatted at 2026-08-07 05:04:11 on dist-test-slave-lgr5"
server_key: "ff23b13149675e654a43499db3a169ad"
server_key_iv: "aaecda472f644b7a0040c53f129fb6ef"
server_key_version: "encryptionkey@0"
I20260807 05:04:11.765555 28027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "f06249c914e145a3809e899a25eb01db"
format_stamp: "Formatted at 2026-08-07 05:04:11 on dist-test-slave-lgr5"
server_key: "ff23b13149675e654a43499db3a169ad"
server_key_iv: "aaecda472f644b7a0040c53f129fb6ef"
server_key_version: "encryptionkey@0"
I20260807 05:04:11.769315 28027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:04:11.771843 28049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:11.773231 28027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:04:11.773366 28027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "f06249c914e145a3809e899a25eb01db"
format_stamp: "Formatted at 2026-08-07 05:04:11 on dist-test-slave-lgr5"
server_key: "ff23b13149675e654a43499db3a169ad"
server_key_iv: "aaecda472f644b7a0040c53f129fb6ef"
server_key_version: "encryptionkey@0"
I20260807 05:04:11.773490 28027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:11.801750 28027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:11.805043 28027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:11.805243 28027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:11.812592 28027 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:41749
I20260807 05:04:11.812610 28135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:41749 every 8 connection(s)
I20260807 05:04:11.813599 28027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:11.816676 28136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:11.822219 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28027
I20260807 05:04:11.822402 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:11.822726 26459 external_mini_cluster.cc:1428] Setting key d5099b1b634d744f606963b7998b4387
I20260807 05:04:11.822739 28136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db: Bootstrap starting.
I20260807 05:04:11.825412 28136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:11.826264 28136 log.cc:824] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:11.828269 28136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db: No bootstrap required, opened a new log
I20260807 05:04:11.831575 28140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:11.824263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51251 (local address 127.25.214.254:41749)
0807 05:04:11.824714 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:11.824729 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:11.824764 (+ 35us) server_negotiation.cc:407] Connection header received
0807 05:04:11.825393 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:11.825410 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:11.825818 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:11.826134 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:11.826616 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:11.827566 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:11.828452 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:11.828959 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:11.829121 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:11.829954 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:11.829960 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:11.829972 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:11.830351 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:11.830403 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:11.830426 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:11.830539 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:11.830736 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 05:04:11.830863 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":135,"threads_started":1}
I20260807 05:04:11.831863 28136 raft_consensus.cc:348] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06249c914e145a3809e899a25eb01db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41749 } }
I20260807 05:04:11.832110 28136 raft_consensus.cc:374] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:11.832175 28136 raft_consensus.cc:729] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06249c914e145a3809e899a25eb01db, State: Initialized, Role: FOLLOWER
I20260807 05:04:11.832680 28136 consensus_queue.cc:260] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06249c914e145a3809e899a25eb01db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41749 } }
I20260807 05:04:11.832852 28136 raft_consensus.cc:388] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:11.832927 28136 raft_consensus.cc:482] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:11.833026 28136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:11.834113 28136 raft_consensus.cc:504] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06249c914e145a3809e899a25eb01db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41749 } }
I20260807 05:04:11.834542 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:11.834489 28136 leader_election.cc:302] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f06249c914e145a3809e899a25eb01db; no voters:
I20260807 05:04:11.834811 28136 leader_election.cc:288] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:11.834903 28143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:11.835131 28143 raft_consensus.cc:686] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [term 1 LEADER]: Becoming Leader. State: Replica: f06249c914e145a3809e899a25eb01db, State: Running, Role: LEADER
I20260807 05:04:11.835495 28143 consensus_queue.cc:237] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06249c914e145a3809e899a25eb01db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41749 } }
I20260807 05:04:11.836042 28136 sys_catalog.cc:564] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:11.836723 28143 sys_catalog.cc:455] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [sys.catalog]: SysCatalogTable state changed. Reason: New leader f06249c914e145a3809e899a25eb01db. Latest consensus state: current_term: 1 leader_uuid: "f06249c914e145a3809e899a25eb01db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06249c914e145a3809e899a25eb01db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41749 } } }
I20260807 05:04:11.836891 28143 sys_catalog.cc:458] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:11.837615 28162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:11.838195 28144 sys_catalog.cc:455] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f06249c914e145a3809e899a25eb01db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06249c914e145a3809e899a25eb01db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 41749 } } }
I20260807 05:04:11.838306 28144 sys_catalog.cc:458] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:11.840724 28162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:11.843498 28140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:11.837789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45513 (local address 127.25.214.254:41749)
0807 05:04:11.837883 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:11.837887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:11.839426 (+ 1539us) server_negotiation.cc:407] Connection header received
0807 05:04:11.839560 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:11.839563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:11.839612 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:11.839703 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:11.839985 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:11.840570 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:11.841638 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:11.841962 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:11.842076 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:11.842947 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:11.842952 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:11.842955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:11.842971 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:11.843001 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:11.843017 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:11.843116 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:11.843314 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 05:04:11.843353 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 05:04:11.846982 28162 catalog_manager.cc:1347] Generated new cluster ID: 52205435763f48fcaba62fa9b1799c81
I20260807 05:04:11.847100 28162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:11.870195 28162 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:11.871222 28162 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:11.880272 28162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f06249c914e145a3809e899a25eb01db: Generated new TSK 0
I20260807 05:04:11.880929 28162 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:11.892555 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28027
W20260807 05:04:11.913606 27999 connection.cc:535] client connection to 127.25.214.254:41749 recv error: Network error: failed to read from TLS socket (remote: 127.25.214.254:41749): Connection reset by peer (error 104)
2026-08-07T05:04:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:11 dist-test-slave-lgr5 krb5kdc[28193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:11 dist-test-slave-lgr5 krb5kdc[28193](info): set up 2 sockets
Aug 07 05:04:11 dist-test-slave-lgr5 krb5kdc[28193](info): commencing operation
krb5kdc: starting...
W20260807 05:04:13.060248 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:13 dist-test-slave-lgr5 krb5kdc[28193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:13.184574 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:39889
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:34003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:39889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:13.298532 28213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:13.298830 28213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:13.298873 28213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:13.302954 28213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:13.303027 28213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:13.303046 28213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:13.303062 28213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:13.303079 28213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:13.308379 28213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:34003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:39889
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:39889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:13.309569 28213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:13.310631 28213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:13.318926 28223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:13.319051 28213 server_base.cc:1034] running on GCE node
W20260807 05:04:13.318964 28220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:13.318966 28219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:13.319705 28213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:13.320801 28213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:13.321964 28213 hybrid_clock.cc:648] HybridClock initialized: now 1786079053321942 us; error 38 us; skew 500 ppm
Aug 07 05:04:13 dist-test-slave-lgr5 krb5kdc[28193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079053, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:13.324632 28213 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:13.325455 28213 webserver.cc:460] Webserver started at http://127.25.214.254:37161/ using document root <none> and password file <none>
I20260807 05:04:13.325979 28213 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:13.326037 28213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:13.326207 28213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:13.328408 28213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "6de3aa5e5b7546339420a42f746f3eae"
format_stamp: "Formatted at 2026-08-07 05:04:13 on dist-test-slave-lgr5"
server_key: "7fd39c94ba9b85549510f5bba0476e1a"
server_key_iv: "86a3afa6cf7edd5daa0b7bbfa9b9b911"
server_key_version: "encryptionkey@0"
I20260807 05:04:13.329041 28213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "6de3aa5e5b7546339420a42f746f3eae"
format_stamp: "Formatted at 2026-08-07 05:04:13 on dist-test-slave-lgr5"
server_key: "7fd39c94ba9b85549510f5bba0476e1a"
server_key_iv: "86a3afa6cf7edd5daa0b7bbfa9b9b911"
server_key_version: "encryptionkey@0"
I20260807 05:04:13.333293 28213 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 05:04:13.336212 28231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:13.337594 28213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:04:13.337716 28213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "6de3aa5e5b7546339420a42f746f3eae"
format_stamp: "Formatted at 2026-08-07 05:04:13 on dist-test-slave-lgr5"
server_key: "7fd39c94ba9b85549510f5bba0476e1a"
server_key_iv: "86a3afa6cf7edd5daa0b7bbfa9b9b911"
server_key_version: "encryptionkey@0"
I20260807 05:04:13.337824 28213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:13.342483 28213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:13.345544 28213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:13.345703 28213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:13.352666 28213 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:39889
I20260807 05:04:13.352684 28313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:39889 every 8 connection(s)
I20260807 05:04:13.353700 28213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:13.356987 28314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:13.361730 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28213
I20260807 05:04:13.361892 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:13.362241 26459 external_mini_cluster.cc:1428] Setting key 55f9b6be90b1af7ebf3adf918a6d4430
I20260807 05:04:13.363540 28314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae: Bootstrap starting.
I20260807 05:04:13.366132 28314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:13.366969 28314 log.cc:824] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:13.367985 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:13.363871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53141 (local address 127.25.214.254:39889)
0807 05:04:13.364386 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:13.364403 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:13.364443 (+ 40us) server_negotiation.cc:407] Connection header received
0807 05:04:13.365140 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:13.365158 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:13.365452 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:13.365788 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:13.366639 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:13.366644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:13.366656 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:13.366666 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:13.366724 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:13.366744 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:13.366840 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:13.366952 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 05:04:13.367117 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":192,"threads_started":1}
I20260807 05:04:13.369313 28314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae: No bootstrap required, opened a new log
I20260807 05:04:13.370980 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:13.373805 28314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de3aa5e5b7546339420a42f746f3eae" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39889 } }
I20260807 05:04:13.374117 28314 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:13.374182 28314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de3aa5e5b7546339420a42f746f3eae, State: Initialized, Role: FOLLOWER
I20260807 05:04:13.374624 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:13.372971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36855 (local address 127.25.214.254:39889)
0807 05:04:13.373090 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:13.373094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:13.373274 (+ 180us) server_negotiation.cc:407] Connection header received
0807 05:04:13.373397 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:13.373400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:13.373433 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:13.373495 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:13.374262 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:13.374265 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:13.374268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:13.374281 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:13.374307 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:13.374318 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:13.374389 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:13.374465 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 05:04:13.374505 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 05:04:13.374699 28314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de3aa5e5b7546339420a42f746f3eae" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39889 } }
I20260807 05:04:13.374881 28314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:13.374964 28314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:13.375053 28314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:13.376073 28314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de3aa5e5b7546339420a42f746f3eae" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39889 } }
I20260807 05:04:13.376461 28314 leader_election.cc:302] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6de3aa5e5b7546339420a42f746f3eae; no voters:
I20260807 05:04:13.376763 28314 leader_election.cc:288] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:13.376854 28328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:13.377044 28328 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [term 1 LEADER]: Becoming Leader. State: Replica: 6de3aa5e5b7546339420a42f746f3eae, State: Running, Role: LEADER
I20260807 05:04:13.377398 28328 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de3aa5e5b7546339420a42f746f3eae" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39889 } }
I20260807 05:04:13.378175 28314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:13.379114 28331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6de3aa5e5b7546339420a42f746f3eae. Latest consensus state: current_term: 1 leader_uuid: "6de3aa5e5b7546339420a42f746f3eae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de3aa5e5b7546339420a42f746f3eae" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39889 } } }
I20260807 05:04:13.379505 28331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:13.379402 28330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6de3aa5e5b7546339420a42f746f3eae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de3aa5e5b7546339420a42f746f3eae" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 39889 } } }
I20260807 05:04:13.379865 28330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae [sys.catalog]: This master's current role is: LEADER
W20260807 05:04:13.382985 28352 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:13.383080 28352 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:13.383212 28343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:13.384188 28343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:13.390472 28343 catalog_manager.cc:1347] Generated new cluster ID: 72daa8e774f84d1388c1303cb224335b
I20260807 05:04:13.390568 28343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:13.410041 28343 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:13.410400 28343 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:13.420367 28343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6de3aa5e5b7546339420a42f746f3eae: Generated new TSK 0
I20260807 05:04:13.421185 28343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:13.433406 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28213
2026-08-07T05:04:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:13 dist-test-slave-lgr5 krb5kdc[28360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:13 dist-test-slave-lgr5 krb5kdc[28360](info): set up 2 sockets
Aug 07 05:04:13 dist-test-slave-lgr5 krb5kdc[28360](info): commencing operation
krb5kdc: starting...
W20260807 05:04:14.586802 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:14 dist-test-slave-lgr5 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:14.713068 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:44945
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:40679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:44945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:14.827756 28385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:14.828049 28385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:14.828127 28385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:14.832247 28385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:14.832312 28385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:14.832331 28385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:14.832347 28385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:14.832368 28385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:14.837824 28385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:40679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:44945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:44945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:14.838986 28385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:14.840060 28385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:14.848743 28394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:14.848750 28393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:14.848754 28397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:14.848920 28385 server_base.cc:1034] running on GCE node
I20260807 05:04:14.849690 28385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:14.850814 28385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:14.851962 28385 hybrid_clock.cc:648] HybridClock initialized: now 1786079054851943 us; error 34 us; skew 500 ppm
Aug 07 05:04:14 dist-test-slave-lgr5 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079054, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:14.854691 28385 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:14.855649 28385 webserver.cc:460] Webserver started at http://127.25.214.254:35283/ using document root <none> and password file <none>
I20260807 05:04:14.856274 28385 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:14.856349 28385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:14.856572 28385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:14.858726 28385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "83ef98e6c27d4c35ab696e9fafb71acc"
format_stamp: "Formatted at 2026-08-07 05:04:14 on dist-test-slave-lgr5"
server_key: "c0eaf795fd81d780ffa485d0bfe8fe18"
server_key_iv: "89611da8e394992723d97cfce4cdbb26"
server_key_version: "encryptionkey@0"
I20260807 05:04:14.859282 28385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "83ef98e6c27d4c35ab696e9fafb71acc"
format_stamp: "Formatted at 2026-08-07 05:04:14 on dist-test-slave-lgr5"
server_key: "c0eaf795fd81d780ffa485d0bfe8fe18"
server_key_iv: "89611da8e394992723d97cfce4cdbb26"
server_key_version: "encryptionkey@0"
I20260807 05:04:14.863106 28385 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 05:04:14.865697 28406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:14.866932 28385 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:04:14.867053 28385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "83ef98e6c27d4c35ab696e9fafb71acc"
format_stamp: "Formatted at 2026-08-07 05:04:14 on dist-test-slave-lgr5"
server_key: "c0eaf795fd81d780ffa485d0bfe8fe18"
server_key_iv: "89611da8e394992723d97cfce4cdbb26"
server_key_version: "encryptionkey@0"
I20260807 05:04:14.867148 28385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:14.886163 28385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:14.889432 28385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:14.889608 28385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:14.896610 28385 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:44945
I20260807 05:04:14.896607 28494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:44945 every 8 connection(s)
I20260807 05:04:14.897680 28385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:14.900310 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28385
I20260807 05:04:14.900457 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:14.900803 26459 external_mini_cluster.cc:1428] Setting key eac0ddbfd7abfdaad58eaffa95c2d432
I20260807 05:04:14.900942 28495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:14.908589 28495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc: Bootstrap starting.
Aug 07 05:04:14 dist-test-slave-lgr5 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:04:14.911484 28495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:14.912276 28495 log.cc:824] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:14.914484 28495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc: No bootstrap required, opened a new log
I20260807 05:04:14.916236 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:14.902412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60335 (local address 127.25.214.254:44945)
0807 05:04:14.902930 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:14.902947 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:14.902985 (+ 38us) server_negotiation.cc:407] Connection header received
0807 05:04:14.903885 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:14.903905 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:14.904342 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:14.904650 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:14.905600 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:14.906618 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:14.907791 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:14.908328 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:14.908447 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:14.911287 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:14.911292 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:14.911306 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:14.911337 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:14.913181 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:14.913650 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:14.913654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:14.913659 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:14.913767 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:14.914052 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:14.914054 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:14.914055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:14.914440 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:14.914592 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:14.914931 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 05:04:14.915256 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":170,"threads_started":1}
I20260807 05:04:14.917963 28495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44945 } }
I20260807 05:04:14.918252 28495 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:14.918361 28495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83ef98e6c27d4c35ab696e9fafb71acc, State: Initialized, Role: FOLLOWER
I20260807 05:04:14.918848 28495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44945 } }
I20260807 05:04:14.919042 28495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:14.919117 28495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:14.919226 28495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:14.919413 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:14.920449 28495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44945 } }
I20260807 05:04:14.920836 28495 leader_election.cc:302] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83ef98e6c27d4c35ab696e9fafb71acc; no voters:
I20260807 05:04:14.921195 28495 leader_election.cc:288] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:14.921288 28507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:14.921526 28507 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [term 1 LEADER]: Becoming Leader. State: Replica: 83ef98e6c27d4c35ab696e9fafb71acc, State: Running, Role: LEADER
I20260807 05:04:14.921948 28507 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44945 } }
I20260807 05:04:14.922607 28495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:14.923659 28510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44945 } } }
I20260807 05:04:14.923794 28510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:14.924012 28510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83ef98e6c27d4c35ab696e9fafb71acc. Latest consensus state: current_term: 1 leader_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ef98e6c27d4c35ab696e9fafb71acc" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 44945 } } }
I20260807 05:04:14.924129 28510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:14.924430 28525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:14.927711 28525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:14.930687 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:14.921767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51235 (local address 127.25.214.254:44945)
0807 05:04:14.921884 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:14.921888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:14.922234 (+ 346us) server_negotiation.cc:407] Connection header received
0807 05:04:14.922343 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:14.922345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:14.922395 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:14.922478 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:14.923267 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:14.924071 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:14.925270 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:14.925489 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:14.925575 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:14.927175 (+ 1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:14.927179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:14.927182 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:14.927208 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:14.928933 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:14.929417 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:14.929421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:14.929423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:14.929514 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:14.929802 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:14.929805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:14.929807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:14.930043 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:14.930175 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:14.930458 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 05:04:14.930574 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 05:04:14.934296 28525 catalog_manager.cc:1347] Generated new cluster ID: d12edeaaa2c647ad8fcc53879123b4b3
I20260807 05:04:14.934365 28525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:14.950237 28525 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:14.951223 28525 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:14.958593 28525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83ef98e6c27d4c35ab696e9fafb71acc: Generated new TSK 0
I20260807 05:04:14.959307 28525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:14.965090 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28385
2026-08-07T05:04:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1525 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:15 dist-test-slave-lgr5 krb5kdc[28542](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:15 dist-test-slave-lgr5 krb5kdc[28542](info): set up 2 sockets
Aug 07 05:04:15 dist-test-slave-lgr5 krb5kdc[28542](info): commencing operation
krb5kdc: starting...
W20260807 05:04:16.109921 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:16 dist-test-slave-lgr5 krb5kdc[28542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:16.233283 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42293
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:38229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:42293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:16.343712 28566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:16.344008 28566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:16.344069 28566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:16.348122 28566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:16.348196 28566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:16.348224 28566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:16.348245 28566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:16.348266 28566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:16.353888 28566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:38229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:42293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:42293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:16.355055 28566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:16.356165 28566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:16.364687 28576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:16.364737 28566 server_base.cc:1034] running on GCE node
W20260807 05:04:16.364658 28575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:16.364643 28578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:16.365494 28566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:16.366659 28566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:16.367827 28566 hybrid_clock.cc:648] HybridClock initialized: now 1786079056367817 us; error 41 us; skew 500 ppm
Aug 07 05:04:16 dist-test-slave-lgr5 krb5kdc[28542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079056, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:16.370764 28566 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:16.371784 28566 webserver.cc:460] Webserver started at http://127.25.214.254:37617/ using document root <none> and password file <none>
I20260807 05:04:16.372408 28566 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:16.372484 28566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:16.372696 28566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:16.374809 28566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "0cb0ace128b74d50945abb6f58dd80db"
format_stamp: "Formatted at 2026-08-07 05:04:16 on dist-test-slave-lgr5"
server_key: "a4833c65c82745bd59ba0ea82198e359"
server_key_iv: "bf51703a4f5e5e2d42ecaa37f27d3db1"
server_key_version: "encryptionkey@0"
I20260807 05:04:16.375388 28566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "0cb0ace128b74d50945abb6f58dd80db"
format_stamp: "Formatted at 2026-08-07 05:04:16 on dist-test-slave-lgr5"
server_key: "a4833c65c82745bd59ba0ea82198e359"
server_key_iv: "bf51703a4f5e5e2d42ecaa37f27d3db1"
server_key_version: "encryptionkey@0"
I20260807 05:04:16.379171 28566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 05:04:16.381757 28589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:16.382941 28566 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 05:04:16.383059 28566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "0cb0ace128b74d50945abb6f58dd80db"
format_stamp: "Formatted at 2026-08-07 05:04:16 on dist-test-slave-lgr5"
server_key: "a4833c65c82745bd59ba0ea82198e359"
server_key_iv: "bf51703a4f5e5e2d42ecaa37f27d3db1"
server_key_version: "encryptionkey@0"
I20260807 05:04:16.383155 28566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:16.393435 28566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:16.396272 28566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:16.396459 28566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:16.403165 28566 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:42293
I20260807 05:04:16.403189 28673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:42293 every 8 connection(s)
I20260807 05:04:16.404142 28566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:16.406847 28674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:16.409301 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28566
I20260807 05:04:16.409454 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:16.409742 26459 external_mini_cluster.cc:1428] Setting key 8ea9164fe20d6f97739024820bb2c973
I20260807 05:04:16.413163 28674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db: Bootstrap starting.
I20260807 05:04:16.415911 28674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:16.416918 28674 log.cc:824] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:16.419011 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:16.411083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53333 (local address 127.25.214.254:42293)
0807 05:04:16.411495 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:16.411510 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:16.411546 (+ 36us) server_negotiation.cc:407] Connection header received
0807 05:04:16.412244 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:16.412266 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:16.412611 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:16.412902 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:16.413317 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:16.414315 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:16.415543 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:16.416071 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:16.416238 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:16.417126 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:16.417131 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:16.417147 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:16.417630 (+ 483us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:16.417697 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:16.417731 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:16.417830 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:16.418016 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 05:04:16.418244 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":110,"threads_started":1}
I20260807 05:04:16.419169 28674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db: No bootstrap required, opened a new log
I20260807 05:04:16.421990 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:16.423583 28674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb0ace128b74d50945abb6f58dd80db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42293 } }
I20260807 05:04:16.423882 28674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:16.423985 28674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb0ace128b74d50945abb6f58dd80db, State: Initialized, Role: FOLLOWER
I20260807 05:04:16.424464 28674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb0ace128b74d50945abb6f58dd80db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42293 } }
I20260807 05:04:16.424623 28674 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:16.424693 28674 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:16.424794 28674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:16.425832 28674 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb0ace128b74d50945abb6f58dd80db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42293 } }
I20260807 05:04:16.426208 28674 leader_election.cc:302] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cb0ace128b74d50945abb6f58dd80db; no voters:
I20260807 05:04:16.426573 28674 leader_election.cc:288] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:16.426630 28688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:16.426851 28688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [term 1 LEADER]: Becoming Leader. State: Replica: 0cb0ace128b74d50945abb6f58dd80db, State: Running, Role: LEADER
I20260807 05:04:16.427191 28688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb0ace128b74d50945abb6f58dd80db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42293 } }
I20260807 05:04:16.427973 28674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:16.428376 28688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cb0ace128b74d50945abb6f58dd80db. Latest consensus state: current_term: 1 leader_uuid: "0cb0ace128b74d50945abb6f58dd80db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb0ace128b74d50945abb6f58dd80db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42293 } } }
I20260807 05:04:16.428912 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:16.424242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58525 (local address 127.25.214.254:42293)
0807 05:04:16.424351 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:16.424356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:16.424585 (+ 229us) server_negotiation.cc:407] Connection header received
0807 05:04:16.424699 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:16.424703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:16.424750 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:16.424822 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:16.425139 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:16.425666 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:16.426743 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:16.427074 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:16.427152 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:16.428185 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:16.428189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:16.428192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:16.428207 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:16.428237 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:16.428250 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:16.428320 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:16.428704 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 05:04:16.428764 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 05:04:16.429126 28688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:16.429023 28692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cb0ace128b74d50945abb6f58dd80db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb0ace128b74d50945abb6f58dd80db" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 42293 } } }
I20260807 05:04:16.430042 28692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:16.430429 28705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:16.433086 28705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:16.439705 28705 catalog_manager.cc:1347] Generated new cluster ID: cf974a2bf7904723bc4cf69c2dc7eaaa
I20260807 05:04:16.439795 28705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:16.453239 28705 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:16.454511 28705 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:16.459769 28705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cb0ace128b74d50945abb6f58dd80db: Generated new TSK 0
I20260807 05:04:16.460602 28705 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:16.464501 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28566
2026-08-07T05:04:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1497 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:16 dist-test-slave-lgr5 krb5kdc[28716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:16 dist-test-slave-lgr5 krb5kdc[28716](info): set up 2 sockets
Aug 07 05:04:16 dist-test-slave-lgr5 krb5kdc[28716](info): commencing operation
krb5kdc: starting...
W20260807 05:04:17.620664 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:17 dist-test-slave-lgr5 krb5kdc[28716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:17.754503 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33547
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:43033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:33547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:17.864514 28742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:17.864761 28742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:17.864801 28742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:17.868650 28742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:17.868700 28742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:17.868716 28742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:17.868737 28742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:17.868750 28742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:17.873801 28742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:43033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:33547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:17.874720 28742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:17.875676 28742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:17.883836 28751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:17.883812 28742 server_base.cc:1034] running on GCE node
W20260807 05:04:17.883788 28747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:17.883800 28748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:17.884683 28742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:17.885715 28742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:17.886868 28742 hybrid_clock.cc:648] HybridClock initialized: now 1786079057886854 us; error 31 us; skew 500 ppm
Aug 07 05:04:17 dist-test-slave-lgr5 krb5kdc[28716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079057, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:17.893009 28742 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:17.893874 28742 webserver.cc:460] Webserver started at http://127.25.214.254:33407/ using document root <none> and password file <none>
I20260807 05:04:17.894412 28742 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:17.894480 28742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:17.894677 28742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:17.896723 28742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "37f0b51d94be4d88987825921212d1fb"
format_stamp: "Formatted at 2026-08-07 05:04:17 on dist-test-slave-lgr5"
server_key: "bbab4192b001185b106c13c52d03552e"
server_key_iv: "328ba8a26812c28af68ff3a3131bede0"
server_key_version: "encryptionkey@0"
I20260807 05:04:17.897246 28742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "37f0b51d94be4d88987825921212d1fb"
format_stamp: "Formatted at 2026-08-07 05:04:17 on dist-test-slave-lgr5"
server_key: "bbab4192b001185b106c13c52d03552e"
server_key_iv: "328ba8a26812c28af68ff3a3131bede0"
server_key_version: "encryptionkey@0"
I20260807 05:04:17.900786 28742 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 05:04:17.903014 28767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:17.904203 28742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:04:17.904312 28742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "37f0b51d94be4d88987825921212d1fb"
format_stamp: "Formatted at 2026-08-07 05:04:17 on dist-test-slave-lgr5"
server_key: "bbab4192b001185b106c13c52d03552e"
server_key_iv: "328ba8a26812c28af68ff3a3131bede0"
server_key_version: "encryptionkey@0"
I20260807 05:04:17.904402 28742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:17.908798 28742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:17.911890 28742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:17.912070 28742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:17.918936 28742 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:33547
I20260807 05:04:17.918951 28841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:33547 every 8 connection(s)
I20260807 05:04:17.919847 28742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:17.920789 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28742
I20260807 05:04:17.920944 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:17.921232 26459 external_mini_cluster.cc:1428] Setting key 91816bb89a2b32713a4639ef07297f04
I20260807 05:04:17.923074 28842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:17.926144 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:17.922578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41019 (local address 127.25.214.254:33547)
0807 05:04:17.922995 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:17.923009 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:17.923052 (+ 43us) server_negotiation.cc:407] Connection header received
0807 05:04:17.923692 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:17.923709 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:17.923969 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:17.924310 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:17.925047 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:17.925052 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:17.925063 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:17.925074 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:17.925127 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:17.925146 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:17.925267 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:17.925345 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 05:04:17.925492 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":134,"threads_started":1}
I20260807 05:04:17.928790 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:17.929039 28842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb: Bootstrap starting.
I20260807 05:04:17.931166 28842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:17.931924 28842 log.cc:824] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:17.932160 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:17.930648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48665 (local address 127.25.214.254:33547)
0807 05:04:17.930763 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:17.930767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:17.930970 (+ 203us) server_negotiation.cc:407] Connection header received
0807 05:04:17.931073 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:17.931076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:17.931107 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:17.931167 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:17.931778 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:17.931781 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:17.931784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 05:04:17.931795 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:17.931821 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 05:04:17.931831 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:17.931898 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:17.931981 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 05:04:17.932014 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:04:17.933826 28842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb: No bootstrap required, opened a new log
I20260807 05:04:17.937232 28842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f0b51d94be4d88987825921212d1fb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33547 } }
I20260807 05:04:17.937434 28842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 05:04:17.937474 28842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37f0b51d94be4d88987825921212d1fb, State: Initialized, Role: FOLLOWER
I20260807 05:04:17.937820 28842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f0b51d94be4d88987825921212d1fb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33547 } }
I20260807 05:04:17.937927 28842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 05:04:17.937969 28842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 05:04:17.938040 28842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:17.938798 28842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f0b51d94be4d88987825921212d1fb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33547 } }
I20260807 05:04:17.939075 28842 leader_election.cc:302] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37f0b51d94be4d88987825921212d1fb; no voters:
I20260807 05:04:17.939356 28842 leader_election.cc:288] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 05:04:17.939452 28857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:17.939656 28857 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [term 1 LEADER]: Becoming Leader. State: Replica: 37f0b51d94be4d88987825921212d1fb, State: Running, Role: LEADER
I20260807 05:04:17.939929 28857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f0b51d94be4d88987825921212d1fb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33547 } }
I20260807 05:04:17.940430 28842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:17.941437 28861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37f0b51d94be4d88987825921212d1fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f0b51d94be4d88987825921212d1fb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33547 } } }
I20260807 05:04:17.941567 28861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:17.941977 28870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:17.941887 28862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37f0b51d94be4d88987825921212d1fb. Latest consensus state: current_term: 1 leader_uuid: "37f0b51d94be4d88987825921212d1fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f0b51d94be4d88987825921212d1fb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33547 } } }
I20260807 05:04:17.942490 28862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:17.944666 28870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:17.949601 28870 catalog_manager.cc:1347] Generated new cluster ID: 51795a1f76b04ab99038553635855466
I20260807 05:04:17.949671 28870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:17.968888 28870 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:17.969265 28870 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:17.983312 28870 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37f0b51d94be4d88987825921212d1fb: Generated new TSK 0
I20260807 05:04:17.984258 28870 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 05:04:17.990624 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28742
2026-08-07T05:04:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1546 ms)
[----------] 18 tests from AuthTokenIssuingTest (27561 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:18 dist-test-slave-lgr5 krb5kdc[28892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:18 dist-test-slave-lgr5 krb5kdc[28892](info): set up 2 sockets
Aug 07 05:04:18 dist-test-slave-lgr5 krb5kdc[28892](info): commencing operation
krb5kdc: starting...
W20260807 05:04:19.164418 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:19.290422 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33269
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:33269,127.25.214.253:38557,127.25.214.252:33917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:19.400189 28911 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 05:04:19.400485 28911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:19.400507 28911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:19.400547 28911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:19.404536 28911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:19.404614 28911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:19.404632 28911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:19.404647 28911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:19.404661 28911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:19.410538 28911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:33269,127.25.214.253:38557,127.25.214.252:33917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:33269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:19.411733 28911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:19.412868 28911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:19.421564 28920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:19.421558 28916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:19.421613 28911 server_base.cc:1034] running on GCE node
W20260807 05:04:19.421558 28918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:19.422351 28911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:19.423409 28911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:19.424571 28911 hybrid_clock.cc:648] HybridClock initialized: now 1786079059424558 us; error 28 us; skew 500 ppm
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:19.427352 28911 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:19.428274 28911 webserver.cc:460] Webserver started at http://127.25.214.254:44195/ using document root <none> and password file <none>
I20260807 05:04:19.428817 28911 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:19.428876 28911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:19.429075 28911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:19.431160 28911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "444290e0c6044c618e5e9f35d0f768bb"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "dcd0c4a90578ce3cdcca84cdb842c45b"
server_key_iv: "aa1b95de11ec41c32ddf8b64ede7139c"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.431720 28911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "444290e0c6044c618e5e9f35d0f768bb"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "dcd0c4a90578ce3cdcca84cdb842c45b"
server_key_iv: "aa1b95de11ec41c32ddf8b64ede7139c"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.435413 28911 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 05:04:19.437880 28934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:19.439028 28911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 05:04:19.439147 28911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "444290e0c6044c618e5e9f35d0f768bb"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "dcd0c4a90578ce3cdcca84cdb842c45b"
server_key_iv: "aa1b95de11ec41c32ddf8b64ede7139c"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.439248 28911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:19.466991 28911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:19.470058 28911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:19.470247 28911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:19.477442 28911 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:33269
I20260807 05:04:19.477761 29021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:33269 every 8 connection(s)
I20260807 05:04:19.478471 28911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:19.481539 29022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:19.485376 29022 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.487123 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 28911
I20260807 05:04:19.487258 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:19.487515 26459 external_mini_cluster.cc:1428] Setting key f6faee832f52e416f6e0aee79268ee71
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.253@KRBTEST.COM" created.
I20260807 05:04:19.500725 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.487819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:33269 (local address 127.0.0.1:49788)
0807 05:04:19.488403 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.488460 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.489485 (+ 1025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.490268 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.490272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.490607 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.490866 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.490879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.492022 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.492026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.493218 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.493230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.493871 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.493875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.494000 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.494578 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.494598 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.496360 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.498020 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.498028 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.498037 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.498254 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.498543 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.498546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.498547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.498647 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.499255 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.499262 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.499421 (+ 159us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.499588 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.499851 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":181,"threads_started":1}
I20260807 05:04:19.500731 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.487819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49788 (local address 127.25.214.254:33269)
0807 05:04:19.488421 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.488443 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.488627 (+ 184us) server_negotiation.cc:407] Connection header received
0807 05:04:19.489833 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.489839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.490075 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.490259 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.491028 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.491887 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.493334 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.493712 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.493830 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.496515 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.496521 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.496546 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.496570 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.497920 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.498341 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.498345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.498346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.498473 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.498722 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.498724 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.498725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.499143 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.499257 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.499713 (+ 456us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.499968 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":477,"spinlock_wait_cycles":54144,"thread_start_us":193,"threads_started":1}
I20260807 05:04:19.502934 29022 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.503665 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.503378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:34890)
0807 05:04:19.503506 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.503593 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 05:04:19.503894 28939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
I20260807 05:04:19.504732 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.504487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:34900)
0807 05:04:19.504612 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.504668 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 05:04:19.504886 29022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:38557: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab.
Entry for principal kudu/127.25.214.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab.
I20260807 05:04:19.514874 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:38557
--webserver_interface=127.25.214.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab
--principal=kudu/127.25.214.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:33269,127.25.214.253:38557,127.25.214.252:33917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:04:19.554140 29022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } attempt: 1
I20260807 05:04:19.555153 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.554807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:34908)
0807 05:04:19.554970 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.555068 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 05:04:19.555871 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.555651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:34910)
0807 05:04:19.555763 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.555809 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 05:04:19.555998 29022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:38557: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
I20260807 05:04:19.624156 29022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } attempt: 2
I20260807 05:04:19.625128 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.624731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:38860)
0807 05:04:19.624888 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.624966 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 05:04:19.625890 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.625660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:38870)
0807 05:04:19.625771 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.625828 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 05:04:19.626012 29022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:38557: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38557: connect: Connection refused (error 111)
W20260807 05:04:19.627606 29032 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 05:04:19.627900 29032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:19.627938 29032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:19.628002 29032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:19.632140 29032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:19.632201 29032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:19.632227 29032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:19.632259 29032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:19.632287 29032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:19.637871 29032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:33269,127.25.214.253:38557,127.25.214.252:33917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab
--principal=kudu/127.25.214.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:38557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.214.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:19.639034 29032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:19.640141 29032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:19.649328 29039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:19.649433 29032 server_base.cc:1034] running on GCE node
W20260807 05:04:19.649329 29038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:19.649366 29042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:19.650209 29032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:19.651322 29032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:19.652510 29032 hybrid_clock.cc:648] HybridClock initialized: now 1786079059652477 us; error 43 us; skew 500 ppm
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:19.655398 29032 init.cc:377] Logged in from keytab as kudu/127.25.214.253@KRBTEST.COM (short username kudu)
I20260807 05:04:19.656482 29032 webserver.cc:460] Webserver started at http://127.25.214.253:45127/ using document root <none> and password file <none>
I20260807 05:04:19.657078 29032 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:19.657150 29032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:19.657364 29032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:19.659549 29032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data/instance:
uuid: "adf60661103649369e21c5440bf6261c"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "6c316cb21be1e94cef6537f38f0ef02f"
server_key_iv: "baab3426ff320934f0bf678430e9f560"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.660156 29032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal/instance:
uuid: "adf60661103649369e21c5440bf6261c"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "6c316cb21be1e94cef6537f38f0ef02f"
server_key_iv: "baab3426ff320934f0bf678430e9f560"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.663930 29032 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 05:04:19.666622 29055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:19.667860 29032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:04:19.667984 29032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal
uuid: "adf60661103649369e21c5440bf6261c"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "6c316cb21be1e94cef6537f38f0ef02f"
server_key_iv: "baab3426ff320934f0bf678430e9f560"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.668113 29032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:19.688751 29032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:19.691835 29032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:19.692028 29032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:19.699158 29032 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.253:38557
I20260807 05:04:19.699411 29148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.253:38557 every 8 connection(s)
I20260807 05:04:19.700201 29032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
I20260807 05:04:19.701102 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29032
I20260807 05:04:19.701218 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-1/wal/instance
I20260807 05:04:19.701501 26459 external_mini_cluster.cc:1428] Setting key 461b469831cbc366c54f1dd9a524da05
I20260807 05:04:19.703028 29150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:19.706681 29150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.214.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.252@KRBTEST.COM" created.
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:04:19.717185 29022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } attempt: 3
I20260807 05:04:19.721544 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.708528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40428 (local address 127.25.214.254:33269)
0807 05:04:19.708708 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.708715 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.709512 (+ 797us) server_negotiation.cc:407] Connection header received
0807 05:04:19.710498 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.710501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.710553 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.710652 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.711904 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.712527 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.713683 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.713917 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.714011 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.716710 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.716713 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.716715 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.716740 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.718560 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.719122 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.719126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.719128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.719228 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.719607 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.719610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.719612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.719839 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.719941 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.721270 (+ 1329us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.721402 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 05:04:19.721853 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.708861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:33269 (local address 127.0.0.1:40428)
0807 05:04:19.709334 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.709388 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.710281 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.710846 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.710853 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.711187 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.711685 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.711699 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.712664 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.712668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.713556 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.713566 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.714064 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.714069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.714245 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.714872 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.714892 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.716537 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.718664 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.718670 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.718684 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.719011 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.719339 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.719342 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.719344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.719510 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.719943 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.719949 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.720274 (+ 325us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.720463 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.720787 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":117,"threads_started":1}
I20260807 05:04:19.723464 29150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
I20260807 05:04:19.728870 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.717682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:38878)
0807 05:04:19.717813 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.717825 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.717905 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.718837 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.718840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.719003 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.719127 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.719135 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.720320 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.720323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.721138 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.721150 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.721928 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.721932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.722043 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.722553 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.722564 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.725148 (+ 2584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.727184 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.727187 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.727189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.727444 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.727749 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.727752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.727754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.727849 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.728350 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.728354 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.728455 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.728539 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.728637 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
I20260807 05:04:19.729200 29156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.718053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38878 (local address 127.25.214.253:38557)
0807 05:04:19.718395 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.718408 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.718433 (+ 25us) server_negotiation.cc:407] Connection header received
0807 05:04:19.718477 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.718483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.718693 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.718845 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.719224 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.720207 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.721286 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.721804 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.721919 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.725268 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.725277 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.725290 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.725314 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.727074 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.727554 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.727560 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.727562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.727650 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.727940 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.727942 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.727943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.728238 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.728371 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.728642 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.728781 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":122,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab.
Entry for principal kudu/127.25.214.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab.
I20260807 05:04:19.730751 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:33917
--webserver_interface=127.25.214.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab
--principal=kudu/127.25.214.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:46089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:33269,127.25.214.253:38557,127.25.214.252:33917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:04:19.732352 29022 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.732465 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.723902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:38890)
0807 05:04:19.723993 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.724005 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.724064 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.724525 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.724528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.724668 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.724744 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.724749 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.725636 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.725640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.726482 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.726493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.727132 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.727137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.727371 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.727899 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.727914 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.729326 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.731175 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.731178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.731180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.731349 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.731608 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.731611 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.731613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.731685 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.731998 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.732001 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.732106 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.732210 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.732325 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 05:04:19.732869 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.724006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38890 (local address 127.25.214.253:38557)
0807 05:04:19.724315 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.724324 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.724336 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:04:19.724393 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.724395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.724427 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.724500 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.724841 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.725542 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.726666 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.727004 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.727103 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.729472 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.729476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.729478 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.729502 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.731081 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.731456 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.731459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.731461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.731531 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.731759 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.731762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.731764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.731916 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.731996 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.732640 (+ 644us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.732755 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":135,"threads_started":1}
I20260807 05:04:19.733392 29150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.733482 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.732929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47730)
0807 05:04:19.733357 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.733411 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357}
I20260807 05:04:19.734205 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.733768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47738)
0807 05:04:19.734095 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.734156 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270}
I20260807 05:04:19.734210 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.733946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47748)
0807 05:04:19.734101 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.734153 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260807 05:04:19.734367 29022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:33917: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
W20260807 05:04:19.734380 29056 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
I20260807 05:04:19.735204 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.735006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47752)
0807 05:04:19.735114 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.735155 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 05:04:19.735364 29150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:33917: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
I20260807 05:04:19.765542 29022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } attempt: 1
I20260807 05:04:19.766625 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.766240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47758)
0807 05:04:19.766429 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.766514 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 05:04:19.767450 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.767195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47760)
0807 05:04:19.767305 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.767371 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 05:04:19.767591 29022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:33917: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
I20260807 05:04:19.784644 29150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } attempt: 1
I20260807 05:04:19.785511 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.785228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47772)
0807 05:04:19.785376 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.785435 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 05:04:19.786270 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.786058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47774)
0807 05:04:19.786169 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.786211 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 05:04:19.786397 29150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:33917: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
I20260807 05:04:19.842737 29022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } attempt: 2
I20260807 05:04:19.843691 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.843297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47786)
0807 05:04:19.843494 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.843581 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 05:04:19.844631 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.844373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47788)
0807 05:04:19.844487 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.844552 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 05:04:19.844820 29022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:33917: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
W20260807 05:04:19.848591 29159 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 05:04:19.848927 29159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:19.848966 29159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:19.849007 29159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:19.853264 29159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:19.853348 29159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:19.853370 29159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:19.853389 29159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:19.853406 29159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:19.854574 29150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } attempt: 2
I20260807 05:04:19.855369 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.855090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47796)
0807 05:04:19.855233 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.855293 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 05:04:19.856123 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.855869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47802)
0807 05:04:19.855972 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.856021 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 05:04:19.856233 29150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:33917: Network error: Client connection negotiation failed: client connection to 127.25.214.252:33917: connect: Connection refused (error 111)
I20260807 05:04:19.859254 29159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:46089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:33269,127.25.214.253:38557,127.25.214.252:33917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab
--principal=kudu/127.25.214.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:33917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.214.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:19.860461 29159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:19.861486 29159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 05:04:19.870026 29159 server_base.cc:1034] running on GCE node
W20260807 05:04:19.869976 29169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:19.869983 29173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:19.869987 29175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:19.870864 29159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:19.872031 29159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:19.873276 29159 hybrid_clock.cc:648] HybridClock initialized: now 1786079059873244 us; error 43 us; skew 500 ppm
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:19.875984 29159 init.cc:377] Logged in from keytab as kudu/127.25.214.252@KRBTEST.COM (short username kudu)
I20260807 05:04:19.876881 29159 webserver.cc:460] Webserver started at http://127.25.214.252:38319/ using document root <none> and password file <none>
I20260807 05:04:19.877400 29159 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:19.877457 29159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:19.877640 29159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:19.879667 29159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data/instance:
uuid: "11fffd52612c44e48ef936d4e58ea974"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "4ac1ab76d48e82094f71509fe8e6567d"
server_key_iv: "671141f69a31786446dbce536be2181f"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.880244 29159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal/instance:
uuid: "11fffd52612c44e48ef936d4e58ea974"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "4ac1ab76d48e82094f71509fe8e6567d"
server_key_iv: "671141f69a31786446dbce536be2181f"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.884313 29159 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 05:04:19.886718 29183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:19.887933 29159 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 05:04:19.888059 29159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal
uuid: "11fffd52612c44e48ef936d4e58ea974"
format_stamp: "Formatted at 2026-08-07 05:04:19 on dist-test-slave-lgr5"
server_key: "4ac1ab76d48e82094f71509fe8e6567d"
server_key_iv: "671141f69a31786446dbce536be2181f"
server_key_version: "encryptionkey@0"
I20260807 05:04:19.888200 29159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:19.906858 29159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:19.909816 29159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:19.909997 29159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:19.916930 29159 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.252:33917
I20260807 05:04:19.917199 29279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.252:33917 every 8 connection(s)
I20260807 05:04:19.917958 29159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
I20260807 05:04:19.920835 29280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:19.924994 29280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.928062 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29159
I20260807 05:04:19.928211 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786078774062608-26459-0/minicluster-data/master-2/wal/instance
I20260807 05:04:19.928514 26459 external_mini_cluster.cc:1428] Setting key 60eb815cfea4a823655b7ab5c2cc7c57
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:04:19.940276 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.927097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40440 (local address 127.25.214.254:33269)
0807 05:04:19.927248 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.927252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.928233 (+ 981us) server_negotiation.cc:407] Connection header received
0807 05:04:19.929388 (+ 1155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.929392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.929457 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.929550 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.931045 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.931599 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.932710 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.932983 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.933066 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.935650 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.935654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.935657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.935687 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.938074 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.938664 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.938667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.938668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.938763 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.939105 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.939107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.939108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.939361 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.939463 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.939946 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.940102 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 05:04:19.941290 29283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.927481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:33269 (local address 127.0.0.1:40440)
0807 05:04:19.928023 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.928071 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.929128 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.929809 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.929819 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.930317 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.930880 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.930894 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.931716 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.931719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.932591 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.932601 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.933121 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.933125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.933291 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.933924 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.933940 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.935507 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.938209 (+ 2702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.938218 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.938229 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.938557 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.938859 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.938862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.938871 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.939008 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.939477 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.939482 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.939703 (+ 221us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.939898 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.940272 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":43,"spinlock_wait_cycles":768,"thread_start_us":130,"threads_started":1}
I20260807 05:04:19.941293 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.929368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47814 (local address 127.25.214.252:33917)
0807 05:04:19.929815 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.929826 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.929847 (+ 21us) server_negotiation.cc:407] Connection header received
0807 05:04:19.929880 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.929885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.930070 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.930252 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.930986 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.931966 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.932867 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.933310 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.933411 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.936195 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.936202 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.936212 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.936236 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.938282 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.938776 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.938782 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.938784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.938917 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.939189 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.939193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.939194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.939680 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.939824 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.940133 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.940491 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":350,"spinlock_wait_cycles":12160,"thread_start_us":155,"threads_started":1}
I20260807 05:04:19.942695 29280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.944056 29022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } attempt: 3
I20260807 05:04:19.947394 29150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } attempt: 3
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:04:19.954564 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.944511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47816)
0807 05:04:19.945088 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.945099 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.945161 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.945349 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.945352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.945526 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.945602 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.945608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.946347 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.946351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.947140 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.947151 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.947677 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.947681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.947760 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.948387 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.948398 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.950356 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.952894 (+ 2538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.952897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.952899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.953161 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.953481 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.953486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.953577 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.954039 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.954042 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.954135 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.954241 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.954375 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516}
I20260807 05:04:19.954609 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.944504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.25.214.252:33917)
0807 05:04:19.944620 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.944623 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.945162 (+ 539us) server_negotiation.cc:407] Connection header received
0807 05:04:19.945209 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.945212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.945256 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.945324 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.945705 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.946224 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.947261 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.947547 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.947963 (+ 416us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.950532 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.950536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.950539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.950565 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.952767 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953285 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.953288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.953290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.953374 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953693 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.953697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.953698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.953900 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.954043 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.954329 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.954439 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":47}
I20260807 05:04:19.955341 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.943348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.25.214.253:38557)
0807 05:04:19.943480 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.943484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.943498 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:04:19.943537 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.943539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.943574 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.943639 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.944222 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.944961 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.946247 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.946494 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.946592 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.951204 (+ 4612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.951208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.951211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.951238 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.953024 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953521 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.953524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.953526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.953610 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953915 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.953918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.953920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.954164 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.954261 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.955050 (+ 789us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.955181 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 05:04:19.955821 29283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.943191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38557 (local address 127.0.0.1:38898)
0807 05:04:19.943292 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.943307 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.943387 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.943678 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.943681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.943860 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.944043 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.944051 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.945259 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.945262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.946101 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.946110 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.946599 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.946602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.946704 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.947597 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.947611 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.951047 (+ 3436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.953145 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953149 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.953151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.953391 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.953726 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.953729 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.953731 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.953814 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.954765 (+ 951us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.954768 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.954853 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.955537 (+ 684us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.955664 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":2}
I20260807 05:04:19.956171 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.944151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40442 (local address 127.25.214.254:33269)
0807 05:04:19.944262 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.944267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.944281 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:04:19.944596 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.944599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.944645 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.944720 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.945300 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.946067 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.947152 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.947363 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.947456 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.951751 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.951755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.951758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.951784 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.953794 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.954601 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.954605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.954606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.954764 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.955115 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.955118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.955120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.955318 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.955520 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.955891 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.956012 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:04:19.957291 29280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:19.958527 29022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: Bootstrap starting.
I20260807 05:04:19.958592 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.947871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47822)
0807 05:04:19.948176 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.948189 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.948267 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.949193 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.949195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.949332 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.949415 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.949420 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.950485 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.950497 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.951136 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.951148 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.951807 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.951811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.951904 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.952504 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.952521 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.953972 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.957093 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.957096 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.957098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.957307 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.957611 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.957615 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.957617 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.957710 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.958147 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.958149 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.958242 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.958323 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.958446 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260807 05:04:19.959189 29286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.948147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47822 (local address 127.25.214.252:33917)
0807 05:04:19.948964 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.948971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.948981 (+ 10us) server_negotiation.cc:407] Connection header received
0807 05:04:19.949020 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.949022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.949053 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.949526 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.949619 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.950374 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.951283 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.951675 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.952102 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.954111 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.954114 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.954117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.954137 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.956990 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.957413 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.957416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.957418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.957506 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.957826 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.957829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.957830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.958037 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.958831 (+ 794us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.958910 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.959034 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":122,"threads_started":1}
I20260807 05:04:19.961530 29022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:19.962163 29150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: Bootstrap starting.
I20260807 05:04:19.962513 29022 log.cc:824] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: Log is configured to *not* fsync() on all Append() calls
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
Aug 07 05:04:19 dist-test-slave-lgr5 krb5kdc[28892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
I20260807 05:04:19.964727 29022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: No bootstrap required, opened a new log
I20260807 05:04:19.964941 29150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:19.965811 29150 log.cc:824] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:19.968155 29283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.957754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:33917 (local address 127.0.0.1:47838)
0807 05:04:19.957905 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:19.957918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:19.957987 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:19.959417 (+ 1430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:19.959419 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:19.959585 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:19.959671 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.959678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.960554 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.960557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.961249 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:19.961260 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.961929 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.961932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:19.962002 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.962370 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:19.962383 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:19.964477 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:19.966689 (+ 2212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.966692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.966694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.966930 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.967196 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:19.967198 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:19.967200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:19.967268 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:19.967652 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:19.967654 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:19.967726 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 05:04:19.967814 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 05:04:19.967959 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260807 05:04:19.968158 29150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: No bootstrap required, opened a new log
I20260807 05:04:19.968449 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.958142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38906 (local address 127.25.214.253:38557)
0807 05:04:19.958343 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.958347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.958358 (+ 11us) server_negotiation.cc:407] Connection header received
0807 05:04:19.958386 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.958389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.958426 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.958509 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.959187 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.959868 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.960939 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.961239 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.961313 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.964716 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.964720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.964722 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.964747 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.966526 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.967035 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.967039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.967041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.967128 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.967431 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.967434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.967436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.967655 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.967793 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.968199 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.968313 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260807 05:04:19.968909 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.958238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47838 (local address 127.25.214.252:33917)
0807 05:04:19.959008 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.959012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:19.959023 (+ 11us) server_negotiation.cc:407] Connection header received
0807 05:04:19.959053 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:19.959055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:19.959091 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:19.959157 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:19.959773 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.960414 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.961367 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:19.961734 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:19.961809 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:19.964616 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:19.964620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:19.964623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:19.964644 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:19.966574 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.967037 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.967040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.967041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.967116 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:19.967343 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:19.967346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:19.967347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:19.967541 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:19.967622 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:19.968483 (+ 861us) server_negotiation.cc:299] Negotiation successful
0807 05:04:19.968779 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334}
I20260807 05:04:19.968950 29022 raft_consensus.cc:348] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.969189 29022 raft_consensus.cc:729] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 444290e0c6044c618e5e9f35d0f768bb, State: Initialized, Role: FOLLOWER
I20260807 05:04:19.969518 29022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.970052 29291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:19.970202 29291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:19.970882 29022 sys_catalog.cc:564] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: configured and running, proceeding with master startup.
W20260807 05:04:19.971848 28948 tablet.cc:2369] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:04:19.971967 29150 raft_consensus.cc:348] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.972239 29150 raft_consensus.cc:729] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf60661103649369e21c5440bf6261c, State: Initialized, Role: FOLLOWER
I20260807 05:04:19.972585 29150 consensus_queue.cc:260] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
W20260807 05:04:19.976747 29313 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:19.976899 29313 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:19.977494 29280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: Bootstrap starting.
I20260807 05:04:19.978812 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:19.979377 29150 sys_catalog.cc:564] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:19.980394 29280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:19.980887 28976 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "444290e0c6044c618e5e9f35d0f768bb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40442
I20260807 05:04:19.981215 28976 raft_consensus.cc:482] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 05:04:19.981325 28976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:19.981326 29280 log.cc:824] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:19.982205 29312 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:19.982331 29312 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:19.979058 28911 master_runner.cc:186] Error getting master registration for 127.25.214.253:38557: OK, instance_id { permanent_uuid: "adf60661103649369e21c5440bf6261c" instance_seqno: 1786079059697205 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 05:04:19.982455 28911 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 05:04:19.982606 28976 raft_consensus.cc:504] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.983572 28976 leader_election.cc:288] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [CANDIDATE]: Term 1 election: Requested vote from peers adf60661103649369e21c5440bf6261c (127.25.214.253:38557), 11fffd52612c44e48ef936d4e58ea974 (127.25.214.252:33917)
I20260807 05:04:19.984251 29096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "444290e0c6044c618e5e9f35d0f768bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "adf60661103649369e21c5440bf6261c"
I20260807 05:04:19.985956 29096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:19.987378 29096 raft_consensus.cc:2454] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 444290e0c6044c618e5e9f35d0f768bb in term 1.
I20260807 05:04:19.987680 29280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: No bootstrap required, opened a new log
I20260807 05:04:19.987968 28939 leader_election.cc:302] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 444290e0c6044c618e5e9f35d0f768bb, adf60661103649369e21c5440bf6261c; no voters:
I20260807 05:04:19.988299 29291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:19.988535 29291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [term 1 LEADER]: Becoming Leader. State: Replica: 444290e0c6044c618e5e9f35d0f768bb, State: Running, Role: LEADER
I20260807 05:04:19.988866 29291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.990741 29291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 444290e0c6044c618e5e9f35d0f768bb. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:19.990885 29291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:19.991176 29280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.991441 29280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11fffd52612c44e48ef936d4e58ea974, State: Initialized, Role: FOLLOWER
I20260807 05:04:19.991775 29280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } }
I20260807 05:04:19.993369 29280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:19.993988 29232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "444290e0c6044c618e5e9f35d0f768bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "11fffd52612c44e48ef936d4e58ea974"
I20260807 05:04:19.994220 29232 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [term 0 FOLLOWER]: Advancing to term 1
W20260807 05:04:19.986456 29332 catalog_manager.cc:1558] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:19.995373 29332 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:19.996148 29232 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 444290e0c6044c618e5e9f35d0f768bb in term 1.
I20260807 05:04:19.997200 29342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:19.997337 29342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:19.998952 29341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:19.999976 29341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:19.998633 29032 master_runner.cc:186] Error getting master registration for 127.25.214.252:33917: OK, instance_id { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" instance_seqno: 1786079059914862 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 05:04:20.002377 29032 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 05:04:20.003036 29361 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:20.003160 29361 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:20.013036 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.998440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47846 (local address 127.25.214.252:33917)
0807 05:04:19.998547 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.998551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.003574 (+ 5023us) server_negotiation.cc:407] Connection header received
0807 05:04:20.003791 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.003794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.003846 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.003913 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.004988 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:20.005734 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:20.006945 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:20.007274 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:20.007364 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:20.009325 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:20.009342 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:20.009346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:20.009373 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:20.011066 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:20.011581 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:20.011586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:20.011588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:20.011673 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:20.011980 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:20.011983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:20.011985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:20.012258 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:20.012398 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:20.012737 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 05:04:20.012864 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 05:04:20.022015 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.998231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40454 (local address 127.25.214.254:33269)
0807 05:04:19.998357 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.998361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.013604 (+ 15243us) server_negotiation.cc:407] Connection header received
0807 05:04:20.013790 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.013794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.013852 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.013904 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.014642 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:20.015395 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:20.016475 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:20.016801 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:20.016871 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:20.018488 (+ 1617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:20.018491 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:20.018494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:20.018522 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:20.020123 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:20.020598 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:20.020601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:20.020603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:20.020687 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:20.021001 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:20.021004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:20.021006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:20.021233 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:20.021354 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:20.021733 (+ 379us) server_negotiation.cc:299] Negotiation successful
0807 05:04:20.021852 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 05:04:20.024636 29232 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [term 1 FOLLOWER]: Refusing update from remote peer 444290e0c6044c618e5e9f35d0f768bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:04:20.024940 29096 raft_consensus.cc:1261] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [term 1 FOLLOWER]: Refusing update from remote peer 444290e0c6044c618e5e9f35d0f768bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:04:20.025511 29291 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:04:20.025969 29291 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:04:20.026028 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:19.996496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38916 (local address 127.25.214.253:38557)
0807 05:04:19.996627 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:19.996631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.012390 (+ 15759us) server_negotiation.cc:407] Connection header received
0807 05:04:20.012604 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.012608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.012667 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.012719 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.015109 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:20.015801 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:20.020004 (+ 4203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:20.020349 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:20.020427 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:20.022110 (+ 1683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:20.022113 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:20.022116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:20.022145 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:20.024048 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:20.024527 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:20.024531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:20.024532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:20.024619 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:20.025154 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:20.025157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:20.025159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:20.025378 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:20.025460 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:20.025770 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 05:04:20.025881 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 05:04:20.029767 29342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 444290e0c6044c618e5e9f35d0f768bb. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:20.029887 29342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:20.030407 29312 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 444290e0c6044c618e5e9f35d0f768bb. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:20.030522 29312 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:20.040056 29339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:20.040230 29339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:20.040675 29291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:20.040786 29291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:20.042098 29342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:20.042210 29342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:20.043224 29312 sys_catalog.cc:455] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "444290e0c6044c618e5e9f35d0f768bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "444290e0c6044c618e5e9f35d0f768bb" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 33269 } } peers { permanent_uuid: "adf60661103649369e21c5440bf6261c" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38557 } } peers { permanent_uuid: "11fffd52612c44e48ef936d4e58ea974" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 33917 } } }
I20260807 05:04:20.043336 29312 sys_catalog.cc:458] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:20.044867 29367 mvcc.cc:205] Tried to move back new op lower bound from 7315779829837602816 to 7315779829718040576. Current Snapshot: MvccSnapshot[applied={T|T < 7315779829837602816}]
I20260807 05:04:20.045025 29372 mvcc.cc:205] Tried to move back new op lower bound from 7315779829837602816 to 7315779829718040576. Current Snapshot: MvccSnapshot[applied={T|T < 7315779829837602816}]
I20260807 05:04:20.045590 29369 mvcc.cc:205] Tried to move back new op lower bound from 7315779829837602816 to 7315779829718040576. Current Snapshot: MvccSnapshot[applied={T|T < 7315779829837602816}]
I20260807 05:04:20.050565 29341 catalog_manager.cc:1347] Generated new cluster ID: 0d5bab97996f403abde0e3950f9b964e
I20260807 05:04:20.050634 29341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:20.071647 29341 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:20.073081 29341 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:20.087579 29341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 444290e0c6044c618e5e9f35d0f768bb: Generated new TSK 0
I20260807 05:04:20.088594 29341 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 05:04:20.128188 29026 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.125110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40468 (local address 127.25.214.254:33269)
0807 05:04:20.125242 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.125247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.126949 (+ 1702us) server_negotiation.cc:407] Connection header received
0807 05:04:20.127179 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.127183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.127238 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.127298 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.127983 (+ 685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40468: BlockingRecv error: recv got EOF from 127.0.0.1:40468 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 05:04:20.129629 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.125927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38920 (local address 127.25.214.253:38557)
0807 05:04:20.126045 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.126050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.128692 (+ 2642us) server_negotiation.cc:407] Connection header received
0807 05:04:20.128854 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.128858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.128911 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.128964 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.129492 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38920: BlockingRecv error: recv got EOF from 127.0.0.1:38920 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 05:04:20.131101 29285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.126676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.25.214.252:33917)
0807 05:04:20.126800 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.126804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.130112 (+ 3308us) server_negotiation.cc:407] Connection header received
0807 05:04:20.130378 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.130381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.130434 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.130491 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.130985 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47850: BlockingRecv error: recv got EOF from 127.0.0.1:47850 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 05:04:20.135757 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.134222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38932 (local address 127.25.214.253:38557)
0807 05:04:20.134328 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.134332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.134788 (+ 456us) server_negotiation.cc:407] Connection header received
0807 05:04:20.134993 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.134997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.135091 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.135145 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.135653 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38932: BlockingRecv error: recv got EOF from 127.0.0.1:38932 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 05:04:20.141611 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.139664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38946 (local address 127.25.214.253:38557)
0807 05:04:20.139792 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.139797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.140483 (+ 686us) server_negotiation.cc:407] Connection header received
0807 05:04:20.140737 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.140741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.140805 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.140866 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.141490 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38946: BlockingRecv error: recv got EOF from 127.0.0.1:38946 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 05:04:20.150487 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.148624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.25.214.253:38557)
0807 05:04:20.148755 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.148760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.149402 (+ 642us) server_negotiation.cc:407] Connection header received
0807 05:04:20.149639 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.149643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.149703 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.149762 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.150341 (+ 579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38952: BlockingRecv error: recv got EOF from 127.0.0.1:38952 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 05:04:20.158300 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.156788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.25.214.253:38557)
0807 05:04:20.156920 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.156923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.157424 (+ 501us) server_negotiation.cc:407] Connection header received
0807 05:04:20.157605 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.157608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.157657 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.157704 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.158190 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38954: BlockingRecv error: recv got EOF from 127.0.0.1:38954 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 05:04:20.170249 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.168703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.25.214.253:38557)
0807 05:04:20.168816 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.168821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.169357 (+ 536us) server_negotiation.cc:407] Connection header received
0807 05:04:20.169539 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.169543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.169590 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.169637 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.170138 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38968: BlockingRecv error: recv got EOF from 127.0.0.1:38968 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 05:04:20.189878 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.188604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38974 (local address 127.25.214.253:38557)
0807 05:04:20.188729 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.188734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.189025 (+ 291us) server_negotiation.cc:407] Connection header received
0807 05:04:20.189159 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.189162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.189218 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.189294 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.189752 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38974: BlockingRecv error: recv got EOF from 127.0.0.1:38974 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 05:04:20.225351 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.224135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.25.214.253:38557)
0807 05:04:20.224268 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.224273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.224455 (+ 182us) server_negotiation.cc:407] Connection header received
0807 05:04:20.224615 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.224618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.224667 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.224736 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.225222 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38984: BlockingRecv error: recv got EOF from 127.0.0.1:38984 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 05:04:20.292670 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.291457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38988 (local address 127.25.214.253:38557)
0807 05:04:20.291644 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.291649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.291729 (+ 80us) server_negotiation.cc:407] Connection header received
0807 05:04:20.291892 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.291895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.291962 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.292030 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.292543 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38988: BlockingRecv error: recv got EOF from 127.0.0.1:38988 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 05:04:20.424047 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.422752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.25.214.253:38557)
0807 05:04:20.422933 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.422939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.423072 (+ 133us) server_negotiation.cc:407] Connection header received
0807 05:04:20.423259 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.423262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.423324 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.423407 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.423932 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38996: BlockingRecv error: recv got EOF from 127.0.0.1:38996 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 05:04:20.683457 29158 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:20.682221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39004 (local address 127.25.214.253:38557)
0807 05:04:20.682404 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:20.682410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:20.682515 (+ 105us) server_negotiation.cc:407] Connection header received
0807 05:04:20.682700 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:20.682705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:20.682758 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:20.682847 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:20.683340 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39004: BlockingRecv error: recv got EOF from 127.0.0.1:39004 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 05:04:20.996752 29332 catalog_manager.cc:1259] Loaded cluster ID: 0d5bab97996f403abde0e3950f9b964e
I20260807 05:04:20.996838 29332 catalog_manager.cc:1552] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: loading cluster ID for follower catalog manager: success
I20260807 05:04:20.998488 29332 catalog_manager.cc:1574] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: acquiring CA information for follower catalog manager: success
I20260807 05:04:20.999626 29332 catalog_manager.cc:1602] T 00000000000000000000000000000000 P adf60661103649369e21c5440bf6261c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:04:21.004436 29361 catalog_manager.cc:1259] Loaded cluster ID: 0d5bab97996f403abde0e3950f9b964e
I20260807 05:04:21.004495 29361 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: loading cluster ID for follower catalog manager: success
I20260807 05:04:21.006053 29361 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: acquiring CA information for follower catalog manager: success
I20260807 05:04:21.007180 29361 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 11fffd52612c44e48ef936d4e58ea974: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:04:21.201541 29480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:21.197792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39012 (local address 127.25.214.253:38557)
0807 05:04:21.198051 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:21.198055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:21.198072 (+ 17us) server_negotiation.cc:407] Connection header received
0807 05:04:21.198219 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:21.198222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:21.198352 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:21.198452 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:21.198666 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.199210 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.200030 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.200304 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.200380 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:21.200672 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:21.201185 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:21.201283 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:21.201316 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 05:04:21.201373 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":78,"threads_started":1}
I20260807 05:04:21.208366 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:21.204748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47854 (local address 127.25.214.252:33917)
0807 05:04:21.204978 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:21.204983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:21.204997 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:04:21.205143 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:21.205146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:21.205264 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:21.205369 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:21.205589 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.206108 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.206924 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.207160 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.207245 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:21.207542 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:21.207958 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:21.208072 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:21.208159 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 05:04:21.208214 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":64,"threads_started":1}
I20260807 05:04:21.214686 29480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:21.211139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39022 (local address 127.25.214.253:38557)
0807 05:04:21.211477 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:21.211481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:21.211495 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:04:21.211540 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:21.211543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:21.211582 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:21.211648 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:21.211890 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.212603 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.213565 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.213846 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.213933 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:21.214218 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:21.214301 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:21.214345 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:21.214491 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 05:04:21.214545 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260807 05:04:21.214848 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:21.211168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47856 (local address 127.25.214.252:33917)
0807 05:04:21.211268 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:21.211271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:21.211644 (+ 373us) server_negotiation.cc:407] Connection header received
0807 05:04:21.211804 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:21.211808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:21.211852 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:21.211916 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:21.212144 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.212734 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.213727 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.214050 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.214148 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:21.214380 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:21.214449 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:21.214520 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:21.214674 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 05:04:21.214725 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 05:04:21.215989 29503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:21.211267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40480 (local address 127.25.214.254:33269)
0807 05:04:21.211480 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:21.211483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:21.211817 (+ 334us) server_negotiation.cc:407] Connection header received
0807 05:04:21.211921 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:21.211924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:21.212118 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:21.212235 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:21.212449 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.213155 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.214234 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:21.214519 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:21.214608 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:21.215280 (+ 672us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:21.215619 (+ 339us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:21.215690 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:21.215796 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 05:04:21.215856 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":65,"threads_started":1}
I20260807 05:04:21.219043 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 28911
I20260807 05:04:21.230991 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29032
I20260807 05:04:21.249169 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29159
2026-08-07T05:04:21Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3240 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 05:04:21 dist-test-slave-lgr5 krb5kdc[29507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 05:04:21 dist-test-slave-lgr5 krb5kdc[29507](info): set up 2 sockets
Aug 07 05:04:21 dist-test-slave-lgr5 krb5kdc[29507](info): commencing operation
krb5kdc: starting...
W20260807 05:04:22.404182 26459 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/test-user.keytab.
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T05:04:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T05:04:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.214.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
Entry for principal kudu/127.25.214.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab.
I20260807 05:04:22.537667 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36645
--webserver_interface=127.25.214.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36645,127.25.214.253:38117,127.25.214.252:46113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 05:04:22.653249 29524 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 05:04:22.653581 29524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:22.653630 29524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:22.653679 29524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 05:04:22.658102 29524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:22.658164 29524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:22.658191 29524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:22.658212 29524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:22.658233 29524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:22.663542 29524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36645,127.25.214.253:38117,127.25.214.252:46113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.254.keytab
--principal=kudu/127.25.214.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.254:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.214.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:22.664701 29524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:22.665742 29524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:22.674222 29531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:22.674228 29534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:22.674330 29524 server_base.cc:1034] running on GCE node
W20260807 05:04:22.674228 29530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:22.675107 29524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:22.676347 29524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:22.677520 29524 hybrid_clock.cc:648] HybridClock initialized: now 1786079062677499 us; error 36 us; skew 500 ppm
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:22.680418 29524 init.cc:377] Logged in from keytab as kudu/127.25.214.254@KRBTEST.COM (short username kudu)
I20260807 05:04:22.681416 29524 webserver.cc:460] Webserver started at http://127.25.214.254:43951/ using document root <none> and password file <none>
I20260807 05:04:22.682001 29524 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:22.682071 29524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:22.682276 29524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:22.684511 29524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data/instance:
uuid: "ed965298bb3c45b9aa2c879d66ab7d1d"
format_stamp: "Formatted at 2026-08-07 05:04:22 on dist-test-slave-lgr5"
server_key: "009997094b7b923d5d5a6c35ed7d43c7"
server_key_iv: "fc7a7b8c7f45d29baedca5b6db9e7224"
server_key_version: "encryptionkey@0"
I20260807 05:04:22.685094 29524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal/instance:
uuid: "ed965298bb3c45b9aa2c879d66ab7d1d"
format_stamp: "Formatted at 2026-08-07 05:04:22 on dist-test-slave-lgr5"
server_key: "009997094b7b923d5d5a6c35ed7d43c7"
server_key_iv: "fc7a7b8c7f45d29baedca5b6db9e7224"
server_key_version: "encryptionkey@0"
I20260807 05:04:22.689127 29524 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 05:04:22.691768 29542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:22.693148 29524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 05:04:22.693295 29524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal
uuid: "ed965298bb3c45b9aa2c879d66ab7d1d"
format_stamp: "Formatted at 2026-08-07 05:04:22 on dist-test-slave-lgr5"
server_key: "009997094b7b923d5d5a6c35ed7d43c7"
server_key_iv: "fc7a7b8c7f45d29baedca5b6db9e7224"
server_key_version: "encryptionkey@0"
I20260807 05:04:22.693420 29524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:22.706795 29524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:22.710012 29524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:22.710201 29524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:22.717185 29524 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.254:36645
I20260807 05:04:22.717459 29631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.254:36645 every 8 connection(s)
I20260807 05:04:22.718174 29524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/data/info.pb
I20260807 05:04:22.721122 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:22.725021 29633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:22.725543 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29524
I20260807 05:04:22.725642 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-0/wal/instance
I20260807 05:04:22.725908 26459 external_mini_cluster.cc:1428] Setting key 2ab3bd236151b8177770461fc75769ed
WARNING: no policy specified for kudu/127.25.214.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.253@KRBTEST.COM" created.
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:04:22.744603 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.727533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43476 (local address 127.25.214.254:36645)
0807 05:04:22.728035 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:22.728056 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:22.728489 (+ 433us) server_negotiation.cc:407] Connection header received
0807 05:04:22.729505 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:22.729511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:22.729712 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:22.729882 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:22.730932 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.731841 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.733343 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.733747 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.733880 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.739441 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:22.739451 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:22.739468 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:22.739498 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:22.741163 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.741819 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.741826 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.741827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.741970 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.742297 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.742300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.742302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.742858 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:22.742999 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:22.743488 (+ 489us) server_negotiation.cc:299] Negotiation successful
0807 05:04:22.743815 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":344,"thread_start_us":139,"threads_started":1}
I20260807 05:04:22.744601 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.727533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36645 (local address 127.0.0.1:43476)
0807 05:04:22.728312 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.728364 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:22.729192 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:22.729940 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:22.729946 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:22.730387 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:22.730757 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.730782 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.731992 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.731996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.733193 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.733205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.733937 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.733941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.734057 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.734652 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:22.734675 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:22.739194 (+ 4519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:22.741300 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.741319 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.741333 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.741685 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.742060 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.742062 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.742064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.742196 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.743026 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:22.743031 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:22.743173 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 05:04:22.743324 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 05:04:22.743690 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"spinlock_wait_cycles":41856,"thread_start_us":166,"threads_started":1}
I20260807 05:04:22.747027 29633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:22.747792 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.747534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53242)
0807 05:04:22.747653 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.747727 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 05:04:22.747991 29546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
I20260807 05:04:22.748940 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.748724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53248)
0807 05:04:22.748838 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.748885 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 05:04:22.749091 29633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:38117: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab.
Entry for principal kudu/127.25.214.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab.
I20260807 05:04:22.755106 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:38117
--webserver_interface=127.25.214.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab
--principal=kudu/127.25.214.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36645,127.25.214.253:38117,127.25.214.252:46113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:04:22.798358 29633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } attempt: 1
I20260807 05:04:22.799340 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.799012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53252)
0807 05:04:22.799176 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.799249 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 05:04:22.800153 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.799879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53266)
0807 05:04:22.799993 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.800045 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 05:04:22.800287 29633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:38117: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
W20260807 05:04:22.868047 29644 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 05:04:22.868343 29644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:22.868381 29644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:22.868453 29644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 05:04:22.868464 29633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } attempt: 2
I20260807 05:04:22.869264 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.868970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53270)
0807 05:04:22.869121 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.869186 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 05:04:22.869942 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.869725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53276)
0807 05:04:22.869828 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.869876 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 05:04:22.870056 29633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.253:38117: Network error: Client connection negotiation failed: client connection to 127.25.214.253:38117: connect: Connection refused (error 111)
W20260807 05:04:22.872702 29644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:22.872752 29644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:22.872779 29644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:22.872810 29644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:22.872835 29644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:22.877950 29644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36645,127.25.214.253:38117,127.25.214.252:46113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.253.keytab
--principal=kudu/127.25.214.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.253:38117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.214.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:22.878913 29644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:22.879868 29644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:22.887885 29653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:22.887964 29660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:22.888042 29644 server_base.cc:1034] running on GCE node
W20260807 05:04:22.887951 29655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:22.888774 29644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:22.889894 29644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:22.891059 29644 hybrid_clock.cc:648] HybridClock initialized: now 1786079062891045 us; error 26 us; skew 500 ppm
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:22.896481 29644 init.cc:377] Logged in from keytab as kudu/127.25.214.253@KRBTEST.COM (short username kudu)
I20260807 05:04:22.897449 29644 webserver.cc:460] Webserver started at http://127.25.214.253:44441/ using document root <none> and password file <none>
I20260807 05:04:22.898005 29644 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:22.898083 29644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:22.898283 29644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:22.900367 29644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data/instance:
uuid: "ef7b52e3fc4643a1b4b6115ae984264a"
format_stamp: "Formatted at 2026-08-07 05:04:22 on dist-test-slave-lgr5"
server_key: "a7a23be660619d37653ecbac36183104"
server_key_iv: "1b0ddb22d9c9aeff341bbc7171493393"
server_key_version: "encryptionkey@0"
I20260807 05:04:22.900910 29644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal/instance:
uuid: "ef7b52e3fc4643a1b4b6115ae984264a"
format_stamp: "Formatted at 2026-08-07 05:04:22 on dist-test-slave-lgr5"
server_key: "a7a23be660619d37653ecbac36183104"
server_key_iv: "1b0ddb22d9c9aeff341bbc7171493393"
server_key_version: "encryptionkey@0"
I20260807 05:04:22.904700 29644 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 05:04:22.907147 29674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:22.908404 29644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 05:04:22.908521 29644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal
uuid: "ef7b52e3fc4643a1b4b6115ae984264a"
format_stamp: "Formatted at 2026-08-07 05:04:22 on dist-test-slave-lgr5"
server_key: "a7a23be660619d37653ecbac36183104"
server_key_iv: "1b0ddb22d9c9aeff341bbc7171493393"
server_key_version: "encryptionkey@0"
I20260807 05:04:22.908627 29644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:22.922710 29644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:22.925427 29644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:22.925595 29644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:22.931921 29644 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.253:38117
I20260807 05:04:22.932245 29757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.253:38117 every 8 connection(s)
I20260807 05:04:22.932900 29644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/data/info.pb
I20260807 05:04:22.935602 29759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:22.939373 29759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:22.942447 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29644
I20260807 05:04:22.942579 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-1/wal/instance
I20260807 05:04:22.942839 26459 external_mini_cluster.cc:1428] Setting key 8d8811cc4a4bb71d4f14e1861c321b2e
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.214.252@KRBTEST.COM; defaulting to no policy
I20260807 05:04:22.952615 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.941185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.25.214.254:36645)
0807 05:04:22.941342 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:22.941345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:22.942055 (+ 710us) server_negotiation.cc:407] Connection header received
0807 05:04:22.942986 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:22.942990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:22.943062 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:22.943149 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:22.944276 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.944943 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.946420 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.946762 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.946864 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.949180 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:22.949184 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:22.949187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:22.949215 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:22.950674 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.951161 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.951165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.951166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.951253 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.951552 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.951555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.951557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.951795 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:22.951884 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:22.952377 (+ 493us) server_negotiation.cc:299] Negotiation successful
0807 05:04:22.952489 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 05:04:22.953487 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.941477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36645 (local address 127.0.0.1:43492)
0807 05:04:22.941906 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.941947 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:22.942783 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:22.943293 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:22.943299 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:22.943638 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:22.944130 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.944149 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.945074 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.945078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.946290 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.946300 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.946919 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.946923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.947065 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.947616 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:22.947632 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:22.949018 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:22.950786 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.950791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.950802 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.951057 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.951336 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.951338 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.951339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.951461 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.951901 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:22.951906 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:22.952166 (+ 260us) client_negotiation.cc:769] Sending connection context
0807 05:04:22.952323 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 05:04:22.952641 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.214.252@KRBTEST.COM" created.
I20260807 05:04:22.954826 29759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
I20260807 05:04:22.961201 29633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } attempt: 3
I20260807 05:04:22.963356 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.955257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53288)
0807 05:04:22.955366 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.955379 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:22.955449 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:22.955982 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:22.955984 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:22.956161 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:22.956241 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.956247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.957166 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.957170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.957672 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.957680 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.958227 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.958230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.958314 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.958745 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:22.958755 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:22.960072 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:22.961953 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.961956 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.961958 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.962151 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.962417 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.962420 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.962422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.962495 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.962914 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:22.962917 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:22.962997 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 05:04:22.963087 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 05:04:22.963203 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 05:04:22.963970 29766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.955398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53288 (local address 127.25.214.253:38117)
0807 05:04:22.955675 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:22.955685 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:22.955704 (+ 19us) server_negotiation.cc:407] Connection header received
0807 05:04:22.955734 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:22.955738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:22.955869 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:22.955977 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:22.956342 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.957060 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.957773 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.958124 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.958213 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.960217 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:22.960225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:22.960235 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:22.960254 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:22.961861 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.962255 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.962261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.962263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.962335 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.962579 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.962582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.962584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.962802 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:22.962930 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:22.963177 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 05:04:22.963296 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":106,"threads_started":1}
I20260807 05:04:22.965864 29759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:04:22 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
I20260807 05:04:22.966621 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.966276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59236)
0807 05:04:22.966478 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.966554 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260807 05:04:22.966879 29677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
I20260807 05:04:22.967692 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.967492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59250)
0807 05:04:22.967595 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.967641 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 05:04:22.967837 29759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:46113: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
I20260807 05:04:22.969717 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.961658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53290)
0807 05:04:22.961779 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.961794 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:22.961876 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:22.962336 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:22.962339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:22.962500 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:22.962595 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.962600 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.963502 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.963506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.964225 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:22.964238 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.964686 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.964689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:22.964792 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.965225 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:22.965239 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:22.966611 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:22.968444 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.968448 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.968450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.968670 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.968899 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:22.968901 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:22.968903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:22.968988 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:22.969285 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:22.969286 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:22.969390 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 05:04:22.969482 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 05:04:22.969605 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 05:04:22.969748 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.961743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53290 (local address 127.25.214.253:38117)
0807 05:04:22.962117 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:22.962125 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:22.962139 (+ 14us) server_negotiation.cc:407] Connection header received
0807 05:04:22.962173 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:22.962176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:22.962217 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:22.962296 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:22.962708 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.963334 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.964338 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:22.964576 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:22.964653 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:22.966789 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:22.966793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:22.966795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:22.966816 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:22.968322 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.968751 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.968753 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.968754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.968823 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:22.969061 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:22.969063 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:22.969064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:22.969215 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:22.969286 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:22.969549 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 05:04:22.969637 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":155,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.214.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab.
Entry for principal kudu/127.25.214.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab.
I20260807 05:04:22.970376 29633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } has no permanent_uuid. Determining permanent_uuid...
I20260807 05:04:22.970930 26459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
/tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:46113
--webserver_interface=127.25.214.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab
--principal=kudu/127.25.214.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.214.212:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.214.254:36645,127.25.214.253:38117,127.25.214.252:46113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 05:04:22.970990 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.970793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59260)
0807 05:04:22.970893 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.970936 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 05:04:22.972509 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:22.972226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59268)
0807 05:04:22.972388 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:22.972446 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260807 05:04:22.972666 29633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:46113: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
I20260807 05:04:23.003844 29633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } attempt: 1
I20260807 05:04:23.004829 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.004457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59274)
0807 05:04:23.004645 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.004723 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 05:04:23.005712 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.005467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59286)
0807 05:04:23.005591 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.005645 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 05:04:23.005877 29633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:46113: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
I20260807 05:04:23.017088 29759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } attempt: 1
I20260807 05:04:23.018046 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.017674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59300)
0807 05:04:23.017852 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.017937 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 05:04:23.018810 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.018578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59304)
0807 05:04:23.018693 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.018745 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 05:04:23.018968 29759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:46113: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
I20260807 05:04:23.081058 29633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } attempt: 2
I20260807 05:04:23.082015 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.081658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59316)
0807 05:04:23.081834 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.081908 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 05:04:23.082796 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.082554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59332)
0807 05:04:23.082668 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.082726 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 05:04:23.082934 29633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:46113: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
W20260807 05:04:23.086185 29769 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 05:04:23.086566 29769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 05:04:23.086615 29769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 05:04:23.086665 29769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 05:04:23.087129 29759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } attempt: 2
I20260807 05:04:23.088055 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.087706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59340)
0807 05:04:23.087877 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.087958 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 05:04:23.088883 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.088634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59346)
0807 05:04:23.088743 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.088803 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 05:04:23.089033 29759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.214.252:46113: Network error: Client connection negotiation failed: client connection to 127.25.214.252:46113: connect: Connection refused (error 111)
W20260807 05:04:23.091614 29769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 05:04:23.091691 29769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 05:04:23.091711 29769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 05:04:23.091727 29769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 05:04:23.091742 29769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 05:04:23.097569 29769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.214.212:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.214.254:36645,127.25.214.253:38117,127.25.214.252:46113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/krb5kdc/kudu_127.25.214.252.keytab
--principal=kudu/127.25.214.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.214.252:46113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.214.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 04:14:58 UTC on ccycloud.quasar-wkuilx.root.comops.site
build id 4571822
I20260807 05:04:23.098723 29769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 05:04:23.099745 29769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 05:04:23.108304 29781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 05:04:23.108304 29779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:23.108388 29769 server_base.cc:1034] running on GCE node
W20260807 05:04:23.108319 29784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 05:04:23.109133 29769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 05:04:23.110260 29769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 05:04:23.111435 29769 hybrid_clock.cc:648] HybridClock initialized: now 1786079063111417 us; error 31 us; skew 500 ppm
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079063, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 05:04:23.114315 29769 init.cc:377] Logged in from keytab as kudu/127.25.214.252@KRBTEST.COM (short username kudu)
I20260807 05:04:23.115298 29769 webserver.cc:460] Webserver started at http://127.25.214.252:39363/ using document root <none> and password file <none>
I20260807 05:04:23.115882 29769 fs_manager.cc:359] Metadata directory not provided
I20260807 05:04:23.115945 29769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 05:04:23.116173 29769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 05:04:23.118305 29769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data/instance:
uuid: "b3612525579e4e5d91a10b7c065c0750"
format_stamp: "Formatted at 2026-08-07 05:04:23 on dist-test-slave-lgr5"
server_key: "4a1c6e0d2565d92cce8cab52725ef295"
server_key_iv: "c48173cc3f5e05371c5472f42cd1ba5f"
server_key_version: "encryptionkey@0"
I20260807 05:04:23.118845 29769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal/instance:
uuid: "b3612525579e4e5d91a10b7c065c0750"
format_stamp: "Formatted at 2026-08-07 05:04:23 on dist-test-slave-lgr5"
server_key: "4a1c6e0d2565d92cce8cab52725ef295"
server_key_iv: "c48173cc3f5e05371c5472f42cd1ba5f"
server_key_version: "encryptionkey@0"
I20260807 05:04:23.122709 29769 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 05:04:23.125263 29795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 05:04:23.126602 29769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 05:04:23.126718 29769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data,/tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal
uuid: "b3612525579e4e5d91a10b7c065c0750"
format_stamp: "Formatted at 2026-08-07 05:04:23 on dist-test-slave-lgr5"
server_key: "4a1c6e0d2565d92cce8cab52725ef295"
server_key_iv: "c48173cc3f5e05371c5472f42cd1ba5f"
server_key_version: "encryptionkey@0"
I20260807 05:04:23.126818 29769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 05:04:23.140884 29769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 05:04:23.144196 29769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 05:04:23.144364 29769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 05:04:23.151183 29769 rpc_server.cc:307] RPC server started. Bound to: 127.25.214.252:46113
I20260807 05:04:23.151459 29879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.214.252:46113 every 8 connection(s)
I20260807 05:04:23.152204 29769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/data/info.pb
I20260807 05:04:23.155130 29880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 05:04:23.158357 26459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu as pid 29769
I20260807 05:04:23.158466 26459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZKK2Ci/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786078774062608-26459-0/minicluster-data/master-2/wal/instance
I20260807 05:04:23.158761 26459 external_mini_cluster.cc:1428] Setting key 603644270f4ff306e4a681785874d8bf
I20260807 05:04:23.159026 29880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079063, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:04:23.170874 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.160963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43504 (local address 127.25.214.254:36645)
0807 05:04:23.161095 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.161100 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.161353 (+ 253us) server_negotiation.cc:407] Connection header received
0807 05:04:23.161752 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.161756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.161811 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.161888 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.162708 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.163218 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.164226 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.164442 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.164533 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.167107 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.167111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.167114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.167142 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.168622 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.169148 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.169151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.169153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.169227 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.169602 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.169605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.169606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.169857 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.169976 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.170585 (+ 609us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.170717 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 05:04:23.171693 29885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.160114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59354 (local address 127.25.214.252:46113)
0807 05:04:23.160538 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.160556 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.160597 (+ 41us) server_negotiation.cc:407] Connection header received
0807 05:04:23.161471 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.161494 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.161729 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.161894 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.162725 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.163567 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.164582 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.164931 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.165028 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.167617 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.167626 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.167640 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.167669 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.169374 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.169821 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.169829 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.169830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.169925 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.170225 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.170228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.170229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.170497 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.170721 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.171169 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.171294 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"spinlock_wait_cycles":1792,"thread_start_us":113,"threads_started":1}
I20260807 05:04:23.171695 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.160882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.254:36645 (local address 127.0.0.1:43504)
0807 05:04:23.161217 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.161257 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:23.161558 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:23.161952 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:23.161958 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:23.162294 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:23.162558 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.162571 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.163327 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.163330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.164110 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.164123 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.164585 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.164589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.164771 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.165290 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:23.165310 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:23.166957 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:23.168730 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.168740 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.168750 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.169051 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.169313 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.169316 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.169318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.169496 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.169977 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:23.169985 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:23.170300 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 05:04:23.170467 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 05:04:23.170767 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":1,"thread_start_us":91,"threads_started":1}
I20260807 05:04:23.173676 29880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079063, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.254@KRBTEST.COM
I20260807 05:04:23.180135 29759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } attempt: 3
I20260807 05:04:23.181962 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.174134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.253:38117 (local address 127.0.0.1:53304)
0807 05:04:23.174307 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.174321 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:23.174392 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:23.174655 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:23.174658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:23.174825 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:23.174931 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.174937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.175873 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.175876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.176476 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.176486 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.177018 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.177022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.177114 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.177539 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:23.177550 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:23.178747 (+ 1197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:23.180392 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.180395 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.180397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.180629 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.180964 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.180967 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.180968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.181056 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.181471 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:23.181474 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:23.181565 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 05:04:23.181674 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 05:04:23.181795 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260807 05:04:23.182035 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.174273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53304 (local address 127.25.214.253:38117)
0807 05:04:23.174409 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.174414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.174448 (+ 34us) server_negotiation.cc:407] Connection header received
0807 05:04:23.174493 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.174496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.174544 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.174618 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.175054 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.175770 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.176604 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.176914 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.176994 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.178882 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.178885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.178887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.178910 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.180294 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.180754 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.180758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.180759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.180850 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.181139 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.181143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.181145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.181345 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.181426 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.181755 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.181876 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 05:04:23.182443 29633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } attempt: 3
I20260807 05:04:23.183492 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.174209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43508 (local address 127.25.214.254:36645)
0807 05:04:23.174385 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.174388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.174599 (+ 211us) server_negotiation.cc:407] Connection header received
0807 05:04:23.174692 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.174695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.174739 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.174813 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.175447 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.175941 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.176731 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.176995 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.177102 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.179486 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.179490 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.179493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.179517 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.181359 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.181779 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.181782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.181784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.181865 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.182167 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.182170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.182172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.182376 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.182580 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.183206 (+ 626us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.183325 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260807 05:04:23.183770 29880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.253@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:04:23.188356 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.180591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59360)
0807 05:04:23.180715 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.180728 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:23.180800 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:23.181021 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:23.181024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:23.181188 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:23.181273 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.181280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.182125 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.182128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.182691 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.182702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.183277 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.183280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.183356 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.183794 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:23.183808 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:23.185289 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:23.186824 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.186827 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.186829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.187069 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.187353 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.187356 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.187358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.187448 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.187868 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:23.187872 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:23.187964 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 05:04:23.188042 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 05:04:23.188199 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 05:04:23.188915 29885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.180664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59360 (local address 127.25.214.252:46113)
0807 05:04:23.180766 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.180770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.180783 (+ 13us) server_negotiation.cc:407] Connection header received
0807 05:04:23.180891 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.180894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.180932 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.180992 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.181384 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.181994 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.182850 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.183160 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.183565 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.185398 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.185402 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.185404 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.185428 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.186716 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.187168 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.187171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.187173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.187254 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.187556 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.187559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.187560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.187751 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.188607 (+ 856us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.188676 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.188768 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.254@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.214.253@KRBTEST.COM
Aug 07 05:04:23 dist-test-slave-lgr5 krb5kdc[29507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786079063, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.214.252@KRBTEST.COM for kudu/127.25.214.252@KRBTEST.COM
I20260807 05:04:23.192389 29759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: Bootstrap starting.
I20260807 05:04:23.194726 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.185103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.25.214.253:38117)
0807 05:04:23.185227 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.185231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.185288 (+ 57us) server_negotiation.cc:407] Connection header received
0807 05:04:23.185471 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.185474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.185514 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.185578 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.186360 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.186972 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.187967 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.188287 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.188361 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.191328 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.191332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.191335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.191357 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.192876 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.193284 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.193287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.193289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.193374 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.193683 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.193687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.193688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.193895 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.194107 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.194469 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.194583 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 05:04:23.195125 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.184449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59388)
0807 05:04:23.187141 (+ 2692us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.187153 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:23.187209 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:23.187646 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:23.187648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:23.187793 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:23.187872 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.187878 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.188866 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.188869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.189538 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.189549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.190042 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.190046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.190112 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.190527 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:23.190551 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:23.191829 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:23.193752 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.193755 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.193757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.194035 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.194281 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194283 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.194285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.194364 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.194713 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:23.194716 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:23.194785 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 05:04:23.194854 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 05:04:23.194965 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2623,"spinlock_wait_cycles":3840}
I20260807 05:04:23.195425 29759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:23.195711 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.182827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.214.252:46113 (local address 127.0.0.1:59372)
0807 05:04:23.184011 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0807 05:04:23.184025 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 05:04:23.184121 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 05:04:23.184811 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 05:04:23.184814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 05:04:23.185050 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 05:04:23.185146 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.185153 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.186644 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.186648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.187320 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 05:04:23.187331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.187947 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.187951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 05:04:23.188032 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.188513 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 05:04:23.188528 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 05:04:23.190101 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 05:04:23.194127 (+ 4026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194131 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.194133 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.194374 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.194688 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194691 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 05:04:23.194693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 05:04:23.194782 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 05:04:23.195232 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 05:04:23.195236 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 05:04:23.195334 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 05:04:23.195413 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 05:04:23.195559 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077}
I20260807 05:04:23.195741 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.184634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59388 (local address 127.25.214.252:46113)
0807 05:04:23.187450 (+ 2816us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.187460 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.187472 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:04:23.187501 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.187504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.187541 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.187956 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.188045 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.188769 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.189650 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.189937 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.191045 (+ 1108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.191955 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.191958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.191960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.191982 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.193644 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194134 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.194136 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.194138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.194207 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194449 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.194451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.194453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.194620 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.195387 (+ 767us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.195461 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.195569 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":734,"server-negotiator.queue_time_us":2756,"thread_start_us":152,"threads_started":1}
I20260807 05:04:23.196365 29887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.183405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59372 (local address 127.25.214.252:46113)
0807 05:04:23.184588 (+ 1183us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.184597 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.184609 (+ 12us) server_negotiation.cc:407] Connection header received
0807 05:04:23.184642 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.184644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.184683 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.185268 (+ 585us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.185360 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.186520 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.187464 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.187818 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.190237 (+ 2419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.190633 (+ 396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.190637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.190639 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.190657 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.194013 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194498 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.194501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.194503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.194585 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.194897 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.194900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.194902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.195112 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.195970 (+ 858us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.196052 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.196209 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1122,"spinlock_wait_cycles":1408,"thread_start_us":120,"threads_started":1}
I20260807 05:04:23.196609 29759 log.cc:824] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:23.198766 29759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: No bootstrap required, opened a new log
I20260807 05:04:23.198808 29880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: Bootstrap starting.
I20260807 05:04:23.199120 29633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: Bootstrap starting.
I20260807 05:04:23.201478 29880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:23.201491 29633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: Neither blocks nor log segments found. Creating new log.
I20260807 05:04:23.201929 29759 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.202108 29759 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7b52e3fc4643a1b4b6115ae984264a, State: Initialized, Role: FOLLOWER
I20260807 05:04:23.202319 29633 log.cc:824] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:23.202346 29880 log.cc:824] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: Log is configured to *not* fsync() on all Append() calls
I20260807 05:04:23.202385 29759 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.203040 29891 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.203183 29891 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.203706 29759 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:23.204497 29633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: No bootstrap required, opened a new log
I20260807 05:04:23.204780 26459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 05:04:23.206111 29587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43508
I20260807 05:04:23.208328 29633 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.208575 29633 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed965298bb3c45b9aa2c879d66ab7d1d, State: Initialized, Role: FOLLOWER
W20260807 05:04:23.208847 29909 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:23.208953 29909 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:23.208905 29633 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.209422 29911 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.209618 29911 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.207185 29644 master_runner.cc:186] Error getting master registration for 127.25.214.254:36645: OK, instance_id { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" instance_seqno: 1786079062715225 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 05:04:23.210285 29644 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 05:04:23.210314 29633 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:23.210347 29587 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 05:04:23.210458 29587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:23.211870 29587 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
W20260807 05:04:23.212244 29554 tablet.cc:2369] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 05:04:23.212949 29587 leader_election.cc:288] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [CANDIDATE]: Term 1 election: Requested vote from peers ef7b52e3fc4643a1b4b6115ae984264a (127.25.214.253:38117), b3612525579e4e5d91a10b7c065c0750 (127.25.214.252:46113)
I20260807 05:04:23.215109 29880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: No bootstrap required, opened a new log
W20260807 05:04:23.215713 29927 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:23.215857 29927 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:23.220846 29718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ef7b52e3fc4643a1b4b6115ae984264a"
I20260807 05:04:23.221179 29718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:23.222667 29718 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed965298bb3c45b9aa2c879d66ab7d1d in term 1.
I20260807 05:04:23.222604 29880 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.223067 29880 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3612525579e4e5d91a10b7c065c0750, State: Initialized, Role: FOLLOWER
I20260807 05:04:23.223642 29880 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.224747 29546 leader_election.cc:302] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed965298bb3c45b9aa2c879d66ab7d1d, ef7b52e3fc4643a1b4b6115ae984264a; no voters:
I20260807 05:04:23.225081 29911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 05:04:23.225310 29911 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [term 1 LEADER]: Becoming Leader. State: Replica: ed965298bb3c45b9aa2c879d66ab7d1d, State: Running, Role: LEADER
I20260807 05:04:23.225658 29911 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } }
I20260807 05:04:23.225981 29845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b3612525579e4e5d91a10b7c065c0750"
I20260807 05:04:23.226222 29845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [term 0 FOLLOWER]: Advancing to term 1
I20260807 05:04:23.227447 29911 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed965298bb3c45b9aa2c879d66ab7d1d. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.227562 29911 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:23.227607 29845 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed965298bb3c45b9aa2c879d66ab7d1d in term 1.
I20260807 05:04:23.228240 29880 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 05:04:23.228291 29933 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.228397 29933 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.234215 29524 master_runner.cc:263] No leader master found from master ed965298bb3c45b9aa2c879d66ab7d1d
I20260807 05:04:23.234297 29524 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 05:04:23.237875 29956 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 05:04:23.237950 29956 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 05:04:23.244591 29938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 05:04:23.247308 29938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 05:04:23.251542 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.231580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.25.214.253:38117)
0807 05:04:23.231691 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.231695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.238670 (+ 6975us) server_negotiation.cc:407] Connection header received
0807 05:04:23.238836 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.238839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.238888 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.238936 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.243678 (+ 4742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.244707 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.246069 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.246378 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.246463 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.248039 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.248043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.248046 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.248074 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.249710 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.250168 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.250171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.250173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.250262 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.250558 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.250562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.250563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.250782 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.250876 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.251237 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.251356 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:04:23.256812 29887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.232215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59404 (local address 127.25.214.252:46113)
0807 05:04:23.232321 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.232326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.248225 (+ 15899us) server_negotiation.cc:407] Connection header received
0807 05:04:23.248474 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.248477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.248537 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.248592 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.249387 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.250161 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.251177 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.251516 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.251595 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.253182 (+ 1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.253186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.253188 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.253216 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.254761 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.255287 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.255291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.255293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.255388 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.255705 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.255708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.255710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.255961 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.256124 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.256502 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.256639 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 05:04:23.247596 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:23.230832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43520 (local address 127.25.214.254:36645)
0807 05:04:23.230967 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.230971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.238364 (+ 7393us) server_negotiation.cc:407] Connection header received
0807 05:04:23.238495 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.238499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.238557 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.238629 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.239686 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.240539 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.241704 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:23.242045 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:23.242133 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:23.244011 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 05:04:23.244015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 05:04:23.244018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 05:04:23.244049 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 05:04:23.245689 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.246172 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.246176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.246178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.246264 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 05:04:23.246562 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 05:04:23.246565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 05:04:23.246567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 05:04:23.246782 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 05:04:23.246893 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:23.247287 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 05:04:23.247414 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 05:04:23.268412 29845 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [term 1 FOLLOWER]: Refusing update from remote peer ed965298bb3c45b9aa2c879d66ab7d1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:04:23.269289 29911 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:04:23.274384 29718 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [term 1 FOLLOWER]: Refusing update from remote peer ed965298bb3c45b9aa2c879d66ab7d1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 05:04:23.274516 29933 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed965298bb3c45b9aa2c879d66ab7d1d. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.274634 29933 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.275090 29911 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 05:04:23.279330 29891 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed965298bb3c45b9aa2c879d66ab7d1d. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.279461 29891 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.285358 29891 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.285497 29891 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.286798 29934 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.286965 29934 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:23.287377 29961 mvcc.cc:205] Tried to move back new op lower bound from 7315779843138781184 to 7315779842975711232. Current Snapshot: MvccSnapshot[applied={T|T < 7315779843138781184}]
I20260807 05:04:23.287825 29968 mvcc.cc:205] Tried to move back new op lower bound from 7315779843138781184 to 7315779842975711232. Current Snapshot: MvccSnapshot[applied={T|T < 7315779843138781184}]
I20260807 05:04:23.292021 29911 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.292217 29911 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d [sys.catalog]: This master's current role is: LEADER
I20260807 05:04:23.292850 29938 catalog_manager.cc:1347] Generated new cluster ID: d331bf294eb943b3b8baa06702c39773
I20260807 05:04:23.292906 29938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 05:04:23.293547 29933 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed965298bb3c45b9aa2c879d66ab7d1d" member_type: VOTER last_known_addr { host: "127.25.214.254" port: 36645 } } peers { permanent_uuid: "ef7b52e3fc4643a1b4b6115ae984264a" member_type: VOTER last_known_addr { host: "127.25.214.253" port: 38117 } } peers { permanent_uuid: "b3612525579e4e5d91a10b7c065c0750" member_type: VOTER last_known_addr { host: "127.25.214.252" port: 46113 } } }
I20260807 05:04:23.293670 29933 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 05:04:23.294358 29964 mvcc.cc:205] Tried to move back new op lower bound from 7315779843138781184 to 7315779842975711232. Current Snapshot: MvccSnapshot[applied={T|T < 7315779843138781184}]
I20260807 05:04:23.322175 29938 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 05:04:23.324115 29938 catalog_manager.cc:1504] Loading token signing keys...
I20260807 05:04:23.348948 29938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed965298bb3c45b9aa2c879d66ab7d1d: Generated new TSK 0
I20260807 05:04:23.349946 29938 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 05:04:23.399113 29635 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.396576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43522 (local address 127.25.214.254:36645)
0807 05:04:23.396717 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.396722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.397976 (+ 1254us) server_negotiation.cc:407] Connection header received
0807 05:04:23.398180 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.398184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.398238 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.398290 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.398967 (+ 677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43522: BlockingRecv error: recv got EOF from 127.0.0.1:43522 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 05:04:23.400285 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.397064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.25.214.253:38117)
0807 05:04:23.397185 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.397191 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.399517 (+ 2326us) server_negotiation.cc:407] Connection header received
0807 05:04:23.399629 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.399632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.399683 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.399755 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.400152 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53332: BlockingRecv error: recv got EOF from 127.0.0.1:53332 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 05:04:23.400980 29887 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.397684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59406 (local address 127.25.214.252:46113)
0807 05:04:23.397817 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.397821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.400217 (+ 2396us) server_negotiation.cc:407] Connection header received
0807 05:04:23.400320 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.400323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.400381 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.400480 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.400863 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59406: BlockingRecv error: recv got EOF from 127.0.0.1:59406 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 05:04:23.417055 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.408441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.25.214.253:38117)
0807 05:04:23.408546 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.408551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.412688 (+ 4137us) server_negotiation.cc:407] Connection header received
0807 05:04:23.416231 (+ 3543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.416235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.416318 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.416382 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.416918 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53334: BlockingRecv error: recv got EOF from 127.0.0.1:53334 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260807 05:04:23.430481 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.428911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53348 (local address 127.25.214.253:38117)
0807 05:04:23.429054 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.429059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.429360 (+ 301us) server_negotiation.cc:407] Connection header received
0807 05:04:23.429566 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.429570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.429631 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.429723 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.430335 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53348: BlockingRecv error: recv got EOF from 127.0.0.1:53348 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 05:04:23.439872 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.434817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53354 (local address 127.25.214.253:38117)
0807 05:04:23.434943 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.434947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.438744 (+ 3797us) server_negotiation.cc:407] Connection header received
0807 05:04:23.438978 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.438981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.439046 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.439104 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.439712 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53354: BlockingRecv error: recv got EOF from 127.0.0.1:53354 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 05:04:23.448616 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.446693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53358 (local address 127.25.214.253:38117)
0807 05:04:23.446894 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.446898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.447518 (+ 620us) server_negotiation.cc:407] Connection header received
0807 05:04:23.447684 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.447688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.447755 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.447859 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.448487 (+ 628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53358: BlockingRecv error: recv got EOF from 127.0.0.1:53358 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260807 05:04:23.460407 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.459104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53366 (local address 127.25.214.253:38117)
0807 05:04:23.459229 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.459234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.459460 (+ 226us) server_negotiation.cc:407] Connection header received
0807 05:04:23.459599 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.459603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.459662 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.459763 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.460276 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53366: BlockingRecv error: recv got EOF from 127.0.0.1:53366 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 05:04:23.480119 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.478788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53376 (local address 127.25.214.253:38117)
0807 05:04:23.478921 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.478926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.479216 (+ 290us) server_negotiation.cc:407] Connection header received
0807 05:04:23.479352 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.479356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.479421 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.479517 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.479964 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53376: BlockingRecv error: recv got EOF from 127.0.0.1:53376 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 05:04:23.515630 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.514419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53392 (local address 127.25.214.253:38117)
0807 05:04:23.514580 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.514585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.514748 (+ 163us) server_negotiation.cc:407] Connection header received
0807 05:04:23.514917 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.514920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.514969 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.515039 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.515520 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53392: BlockingRecv error: recv got EOF from 127.0.0.1:53392 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 05:04:23.583307 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.582043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53408 (local address 127.25.214.253:38117)
0807 05:04:23.582222 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.582228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.582347 (+ 119us) server_negotiation.cc:407] Connection header received
0807 05:04:23.582534 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.582539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.582591 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.582672 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.583196 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53408: BlockingRecv error: recv got EOF from 127.0.0.1:53408 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 05:04:23.714788 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.713660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53410 (local address 127.25.214.253:38117)
0807 05:04:23.713795 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.713799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.713926 (+ 127us) server_negotiation.cc:407] Connection header received
0807 05:04:23.714048 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.714051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.714103 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.714187 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.714677 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53410: BlockingRecv error: recv got EOF from 127.0.0.1:53410 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 05:04:23.974589 29767 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 05:04:23.973295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53412 (local address 127.25.214.253:38117)
0807 05:04:23.973470 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:23.973475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:23.973695 (+ 220us) server_negotiation.cc:407] Connection header received
0807 05:04:23.973830 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:23.973834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:23.973898 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:23.973967 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 05:04:23.974448 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53412: BlockingRecv error: recv got EOF from 127.0.0.1:53412 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 05:04:24.210567 29909 catalog_manager.cc:1259] Loaded cluster ID: d331bf294eb943b3b8baa06702c39773
I20260807 05:04:24.210654 29909 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: loading cluster ID for follower catalog manager: success
I20260807 05:04:24.212819 29909 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: acquiring CA information for follower catalog manager: success
I20260807 05:04:24.214308 29909 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ef7b52e3fc4643a1b4b6115ae984264a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:04:24.239272 29956 catalog_manager.cc:1259] Loaded cluster ID: d331bf294eb943b3b8baa06702c39773
I20260807 05:04:24.239363 29956 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: loading cluster ID for follower catalog manager: success
I20260807 05:04:24.241117 29956 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: acquiring CA information for follower catalog manager: success
I20260807 05:04:24.242282 29956 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b3612525579e4e5d91a10b7c065c0750: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 05:04:24.492882 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:24.489079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53420 (local address 127.25.214.253:38117)
0807 05:04:24.489301 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:24.489305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:24.489321 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:04:24.489469 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:24.489472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:24.489597 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:24.489696 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:24.489974 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.490537 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.491438 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.491673 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.491762 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:24.492046 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:24.492520 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:24.492612 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:24.492701 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 05:04:24.492752 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260807 05:04:24.499655 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:24.495962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59418 (local address 127.25.214.252:46113)
0807 05:04:24.496203 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:24.496207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:24.496222 (+ 15us) server_negotiation.cc:407] Connection header received
0807 05:04:24.496351 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:24.496353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:24.496473 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:24.496576 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:24.496777 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.497373 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.498284 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.498551 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.498642 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:24.498869 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:24.499276 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:24.499396 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:24.499432 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 05:04:24.499485 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260807 05:04:24.506552 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:24.502833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53424 (local address 127.25.214.253:38117)
0807 05:04:24.502950 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:24.502954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:24.503011 (+ 57us) server_negotiation.cc:407] Connection header received
0807 05:04:24.503192 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:24.503195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:24.503249 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:24.503295 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:24.503694 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.504460 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.505464 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.505784 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.505873 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:24.506113 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:24.506184 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:24.506241 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:24.506352 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 05:04:24.506404 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 05:04:24.506999 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:24.502521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43528 (local address 127.25.214.254:36645)
0807 05:04:24.502782 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:24.502786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:24.502802 (+ 16us) server_negotiation.cc:407] Connection header received
0807 05:04:24.502909 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:24.502912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:24.503075 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:24.503441 (+ 366us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:24.503546 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.504287 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.505395 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.505659 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.505758 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:24.506085 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:24.506435 (+ 350us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:24.506779 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:24.506812 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 05:04:24.506864 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260807 05:04:24.506989 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 05:04:24.503173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.25.214.252:46113)
0807 05:04:24.503270 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 05:04:24.503274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 05:04:24.503369 (+ 95us) server_negotiation.cc:407] Connection header received
0807 05:04:24.503480 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 05:04:24.503483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 05:04:24.503529 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 05:04:24.503606 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 05:04:24.503879 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.504645 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.505784 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 05:04:24.506099 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 05:04:24.506168 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 05:04:24.506525 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 05:04:24.506603 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 05:04:24.506643 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 05:04:24.506804 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 05:04:24.506854 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 05:04:24.510087 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29524
I20260807 05:04:24.522975 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29644
I20260807 05:04:24.534435 26459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZKK2Ci/build/debug/bin/kudu with pid 29769
2026-08-07T05:04:24Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3287 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6528 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (290430 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST